2024-09-22T02:53:20.452 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-22T02:53:20.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T02:53:20.568 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914719 branch: squid description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency} email: ceph-qa@ceph.com first_in_suite: false job_id: '7914719' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: bluestore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: min_in: 4 workunit: branch: squid env: CRIMSON_COMPAT: '1' sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 1158 sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 sleep_before_teardown: 0 subset: 0/1 suite: crimson-rados suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 targets: smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1zuj/H5uEUU7dKfzFP/od5dqPfKlATKU8HMHSjV6+zOckM3hcVZ0EQMoL2I2ciK8t9t47TlyIboXkU3wGjTYk= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWT3lOd42nCZxI2mAaw5hiVouBDsT43zsW12biLhYfHjAIRNvQ42k7CKfVBcII1pnZYAZMVVvjcx+pbW7V/2KA= tasks: - install: null - ceph: conf: osd: debug monc: 20 flavor: crimson - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_21:56:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-22T02:53:20.568 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa; will attempt to use it 2024-09-22T02:53:20.569 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa/tasks 2024-09-22T02:53:20.569 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-22T02:53:20.571 INFO:teuthology.task.internal:Checking packages... 2024-09-22T02:53:20.593 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '4e45e6b490e6cbe082cdf155fea780438ec53fc7' 2024-09-22T02:53:20.593 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-22T02:53:20.593 INFO:teuthology.packaging:ref: None 2024-09-22T02:53:20.593 INFO:teuthology.packaging:tag: None 2024-09-22T02:53:20.593 INFO:teuthology.packaging:branch: squid 2024-09-22T02:53:20.593 INFO:teuthology.packaging:sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T02:53:20.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-22T02:53:20.792 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-373.g4e45e6b4 2024-09-22T02:53:20.793 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-22T02:53:20.799 INFO:teuthology.task.internal:no buildpackages task found 2024-09-22T02:53:20.799 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-22T02:53:20.906 INFO:teuthology.task.internal:Saving configuration 2024-09-22T02:53:20.923 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-22T02:53:20.988 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-22T02:53:21.008 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 02:48:26.044196', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1zuj/H5uEUU7dKfzFP/od5dqPfKlATKU8HMHSjV6+zOckM3hcVZ0EQMoL2I2ciK8t9t47TlyIboXkU3wGjTYk='} 2024-09-22T02:53:21.029 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 02:48:26.042262', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWT3lOd42nCZxI2mAaw5hiVouBDsT43zsW12biLhYfHjAIRNvQ42k7CKfVBcII1pnZYAZMVVvjcx+pbW7V/2KA='} 2024-09-22T02:53:21.029 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-22T02:53:21.056 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-22T02:53:21.056 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-22T02:53:21.056 INFO:teuthology.run_tasks:Running task console_log... 2024-09-22T02:53:21.136 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2e7f0e0160>, signals=[15]) 2024-09-22T02:53:21.136 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-22T02:53:21.141 INFO:teuthology.task.internal:Opening connections... 2024-09-22T02:53:21.141 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-22T02:53:21.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:53:21.218 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-09-22T02:53:21.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:53:21.292 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-22T02:53:21.297 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-22T02:53:21.315 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-22T02:53:21.315 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-22T02:53:21.372 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-09-22T02:53:21.372 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-09-22T02:53:21.372 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-09-22T02:53:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-09-22T02:53:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-09-22T02:53:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-09-22T02:53:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T02:53:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-09-22T02:53:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-09-22T02:53:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T02:53:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-09-22T02:53:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T02:53:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T02:53:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T02:53:21.374 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-22T02:53:21.397 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-09-22T02:53:21.416 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-09-22T02:53:21.416 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-09-22T02:53:21.474 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T02:53:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T02:53:21.476 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-09-22T02:53:21.497 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-22T02:53:21.505 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-22T02:53:21.632 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-22T02:53:21.632 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-22T02:53:21.634 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-09-22T02:53:21.651 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-22T02:53:21.735 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-22T02:53:21.735 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-22T02:53:21.738 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-09-22T02:53:21.764 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-22T02:53:21.852 INFO:teuthology.run_tasks:Running task kernel... 2024-09-22T02:53:21.867 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-22T02:53:21.867 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-22T02:53:21.867 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T02:53:21.868 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T02:53:21.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T02:53:21.885 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-22T02:53:21.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T02:53:21.886 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-22T02:53:21.943 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-503.el9.x86_64 2024-09-22T02:53:21.943 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-503.el9.x86_64 2024-09-22T02:53:21.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-09-22T02:53:21.944 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-503.el9.x86_64 2024-09-22T02:53:21.944 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.14.0-503.el9.x86_64 2024-09-22T02:53:21.944 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum install -y kernel 2024-09-22T02:53:24.308 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-22T02:53:25.548 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-22T02:53:27.476 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-22T02:53:31.081 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-22T02:53:33.234 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-22T02:53:34.943 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-22T02:53:35.665 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.5 MB 00:00 2024-09-22T02:53:36.222 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-22T02:53:37.057 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 102 kB/s | 19 kB 00:00 2024-09-22T02:53:38.103 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-22T02:53:41.661 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-09-22T02:53:43.542 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-22T02:53:43.585 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T02:53:43.586 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T02:53:43.684 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T02:53:43.693 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T02:53:43.694 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-09-22T02:53:43.694 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T02:53:43.694 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T02:53:43.694 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T02:53:43.694 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-22T02:53:43.694 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T02:53:43.695 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T02:53:43.695 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T02:53:43.695 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T02:53:43.695 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T02:53:43.695 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T02:53:43.695 INFO:teuthology.orchestra.run.smithi139.stdout:Install 4 Packages 2024-09-22T02:53:43.695 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T02:53:43.696 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 79 M 2024-09-22T02:53:43.696 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 126 M 2024-09-22T02:53:43.696 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T02:53:43.829 INFO:teuthology.orchestra.run.smithi139.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 316 kB/s | 36 kB 00:00 2024-09-22T02:53:45.407 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T02:53:45.407 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T02:53:45.511 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T02:53:45.515 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T02:53:45.515 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-09-22T02:53:45.516 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T02:53:45.517 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 79 M 2024-09-22T02:53:45.517 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 126 M 2024-09-22T02:53:45.517 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T02:53:45.660 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 296 kB/s | 36 kB 00:00 2024-09-22T02:53:45.936 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-09-22T02:53:46.269 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 47 MB/s | 35 MB 00:00 2024-09-22T02:53:46.595 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 31 MB/s | 29 MB 00:00 2024-09-22T02:53:46.595 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T02:53:46.595 INFO:teuthology.orchestra.run.smithi134.stdout:Total 73 MB/s | 79 MB 00:01 2024-09-22T02:53:47.281 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T02:53:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T02:53:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T02:53:48.613 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T02:53:48.613 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T02:53:50.911 INFO:teuthology.orchestra.run.smithi139.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-22T02:53:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T02:53:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T02:53:51.830 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:53:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:53:54.750 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:53:56.986 INFO:teuthology.orchestra.run.smithi139.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:13 2024-09-22T02:53:59.558 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:53:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:00.227 INFO:teuthology.orchestra.run.smithi139.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.1 MB/s | 35 MB 00:16 2024-09-22T02:54:00.228 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T02:54:00.228 INFO:teuthology.orchestra.run.smithi139.stdout:Total 4.8 MB/s | 79 MB 00:16 2024-09-22T02:54:00.907 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T02:54:01.254 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T02:54:01.254 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T02:54:02.203 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T02:54:02.203 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T02:54:04.493 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:04.631 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T02:54:05.328 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T02:54:05.418 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:54:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:54:08.313 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:54:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:54:13.305 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:42.718 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:42.758 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T02:54:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:54:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:54:43.979 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:43.980 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T02:54:43.980 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T02:54:43.980 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T02:54:43.980 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T02:54:43.980 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T02:54:43.980 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T02:54:43.980 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T02:54:43.980 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T02:54:44.322 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T02:54:44.408 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T02:54:44.408 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T02:54:44.408 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T02:54:44.408 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T02:54:44.408 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T02:54:44.408 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-22T02:54:44.408 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T02:54:44.409 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T02:54:44.466 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T02:54:44.466 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T02:54:44.467 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-09-22T02:54:44.498 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-09-22T02:54:44.498 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-09-22T02:54:44.498 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-09-22T02:54:44.498 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 82.el9 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8274670 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-09-22T02:54:44.499 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-09-22T02:54:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T02:54:44.500 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T02:54:44.500 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T02:54:44.500 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T02:54:44.500 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-09-22T02:54:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T02:54:44.500 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T02:54:44.501 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T02:54:44.501 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 5.14.0-508.el9.x86_64 2024-09-22T02:54:44.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T02:54:45.143 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-22T02:54:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T02:54:46.528 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-22T02:54:46.531 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-22T02:54:46.546 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.PXRjdXGQyj 2024-09-22T02:54:46.546 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PXRjdXGQyj 2024-09-22T02:54:46.613 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.PXRjdXGQyj 2024-09-22T02:54:46.760 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.PXRjdXGQyj is 6KB 2024-09-22T02:54:46.779 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.PXRjdXGQyj 2024-09-22T02:54:46.794 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T02:54:46.857 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T02:54:46.857 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T02:54:46.857 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T02:54:46.857 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T02:54:46.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T02:54:46.994 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-09-22T02:54:56.244 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:56.284 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:56.622 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:56.622 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T02:54:56.622 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:54:56.622 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:54:57.474 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:54:57.475 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T02:54:57.475 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T02:54:57.475 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T02:54:57.475 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T02:54:57.475 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T02:54:57.475 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T02:54:57.475 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T02:54:57.475 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T02:54:57.832 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T02:54:57.922 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T02:54:57.922 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T02:54:57.922 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T02:54:57.922 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T02:54:57.922 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T02:54:57.922 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-22T02:54:57.922 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T02:54:57.923 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T02:54:57.981 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T02:54:57.981 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T02:54:57.982 DEBUG:teuthology.orchestra.run.smithi139:> sudo rpm -qi grub2-tools 2024-09-22T02:54:58.022 INFO:teuthology.orchestra.run.smithi139.stdout:Name : grub2-tools 2024-09-22T02:54:58.022 INFO:teuthology.orchestra.run.smithi139.stdout:Epoch : 1 2024-09-22T02:54:58.022 INFO:teuthology.orchestra.run.smithi139.stdout:Version : 2.06 2024-09-22T02:54:58.022 INFO:teuthology.orchestra.run.smithi139.stdout:Release : 82.el9 2024-09-22T02:54:58.022 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: x86_64 2024-09-22T02:54:58.022 INFO:teuthology.orchestra.run.smithi139.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:Group : Unspecified 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:Size : 8274670 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:License : GPLv3+ 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:Packager : builder@centos.org 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:Vendor : CentOS 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:Summary : Support tools for GRUB. 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:Description : 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T02:54:58.023 INFO:teuthology.orchestra.run.smithi139.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T02:54:58.024 INFO:teuthology.orchestra.run.smithi139.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T02:54:58.024 INFO:teuthology.orchestra.run.smithi139.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T02:54:58.024 INFO:teuthology.orchestra.run.smithi139.stdout:hardware devices. 2024-09-22T02:54:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T02:54:58.024 INFO:teuthology.orchestra.run.smithi139.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T02:54:58.025 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T02:54:58.025 INFO:teuthology.task.kernel:Updating grub on smithi139 to boot 5.14.0-508.el9.x86_64 2024-09-22T02:54:58.025 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T02:54:58.741 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2024-09-22T02:55:00.080 INFO:teuthology.orchestra.run.smithi139.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T02:55:00.112 INFO:teuthology.orchestra.run.smithi139.stderr:done 2024-09-22T02:55:00.114 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-09-22T02:55:00.129 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.rBeOY33kqc 2024-09-22T02:55:00.129 DEBUG:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rBeOY33kqc 2024-09-22T02:55:00.195 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.rBeOY33kqc 2024-09-22T02:55:00.328 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.rBeOY33kqc is 6KB 2024-09-22T02:55:00.375 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.rBeOY33kqc 2024-09-22T02:55:00.389 DEBUG:teuthology.orchestra.run.smithi139:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T02:55:00.463 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T02:55:00.463 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T02:55:00.463 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T02:55:00.463 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T02:55:00.464 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T02:55:00.629 DEBUG:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2024-09-22T02:55:17.013 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-22T02:55:17.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-22T02:55:17.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:55:30.645 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-22T02:55:30.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-22T02:55:30.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:56:05.103 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-22T02:56:14.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-22T02:56:14.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:56:17.019 DEBUG:teuthology.orchestra.remote:timed out 2024-09-22T02:56:26.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-22T02:56:26.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:56:26.645 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-22T02:56:27.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-22T02:56:27.040 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-22T02:56:27.041 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-22T02:56:27.055 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-508.el9.x86_64 2024-09-22T02:56:27.056 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T02:56:27.056 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T02:56:27.056 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T02:56:28.056 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-22T02:56:28.057 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T02:56:28.122 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-09-22T02:56:28.147 DEBUG:teuthology.parallel:result is None 2024-09-22T02:56:32.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-22T02:56:44.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-22T02:56:44.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:56:44.859 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-22T02:56:45.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-22T02:56:45.258 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-22T02:56:45.258 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-22T02:56:45.272 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-508.el9.x86_64 2024-09-22T02:56:45.273 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T02:56:45.273 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T02:56:45.273 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T02:56:46.273 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-22T02:56:46.274 DEBUG:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T02:56:46.369 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2024-09-22T02:56:46.393 DEBUG:teuthology.parallel:result is None 2024-09-22T02:56:46.393 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-22T02:56:46.400 INFO:teuthology.task.internal:Creating test directory... 2024-09-22T02:56:46.400 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T02:56:46.403 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T02:56:46.420 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-22T02:56:46.427 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-22T02:56:46.442 INFO:teuthology.task.internal:Creating archive directory... 2024-09-22T02:56:46.442 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T02:56:46.463 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T02:56:46.492 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-22T02:56:46.506 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-22T02:56:46.507 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T02:56:46.530 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T02:56:46.558 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T02:56:46.566 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T02:56:46.569 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T02:56:46.576 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T02:56:46.578 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-22T02:56:46.584 INFO:teuthology.task.internal:Configuring sudo... 2024-09-22T02:56:46.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T02:56:46.614 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T02:56:46.647 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-22T02:56:46.655 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-22T02:56:46.655 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T02:56:46.679 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T02:56:46.706 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T02:56:46.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T02:56:46.869 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T02:56:46.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T02:56:46.953 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T02:56:46.953 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T02:56:47.018 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T02:56:47.060 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T02:56:47.111 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T02:56:47.198 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T02:56:47.241 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T02:56:47.241 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T02:56:47.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-22T02:56:47.310 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-09-22T02:56:47.358 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T02:56:47.410 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T02:56:47.829 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-22T02:56:47.837 INFO:teuthology.task.internal:Starting timer... 2024-09-22T02:56:47.837 INFO:teuthology.run_tasks:Running task pcp... 2024-09-22T02:56:47.883 INFO:teuthology.run_tasks:Running task selinux... 2024-09-22T02:56:47.891 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-22T02:56:47.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-09-22T02:56:47.933 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-09-22T02:56:47.934 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2024-09-22T02:56:47.995 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2024-09-22T02:56:47.997 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-22T02:56:47.997 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-09-22T02:56:48.020 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-09-22T02:56:48.020 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2024-09-22T02:56:48.043 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2024-09-22T02:56:48.043 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi139.front.sepia.ceph.com': 'permissive'} 2024-09-22T02:56:48.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-22T02:56:48.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T02:56:48.086 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-22T02:56:48.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T02:56:48.114 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-22T02:56:48.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-09-22T02:56:48.155 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2024-09-22T02:56:48.189 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-22T02:56:48.199 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-22T02:56:48.201 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-22T02:56:48.301 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-22T02:56:49.183 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-22T02:56:49.184 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi134.front.sepia.ceph.com,smithi139.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-22T03:00:31.629 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com')] 2024-09-22T03:00:31.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-22T03:00:31.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:00:31.710 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-22T03:00:31.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-22T03:00:31.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-22T03:00:31.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:00:31.863 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-22T03:00:31.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-22T03:00:31.939 INFO:teuthology.run_tasks:Running task clock... 2024-09-22T03:00:31.948 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-22T03:00:31.948 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T03:00:31.948 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T03:00:31.950 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T03:00:31.951 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T03:00:31.977 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T03:00:31.991 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T03:00:32.008 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T03:00:32.015 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-09-22T03:00:32.022 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T03:00:32.026 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-09-22T03:00:32.039 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T03:00:32.047 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2024-09-22T03:00:32.053 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T03:00:32.058 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2024-09-22T03:00:32.072 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T03:00:32.087 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T03:00:32.115 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-22T03:00:32.119 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T03:00:32.119 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-22T03:00:32.119 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:00:32.119 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:00:32.119 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:00:32.119 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:00:32.140 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-09-22T03:00:32.144 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T03:00:32.144 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-09-22T03:00:32.144 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:00:32.144 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:00:32.144 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:00:32.144 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:00:32.144 INFO:teuthology.run_tasks:Running task install... 2024-09-22T03:00:32.152 DEBUG:teuthology.task.install:project ceph 2024-09-22T03:00:32.152 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}} 2024-09-22T03:00:32.153 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'} 2024-09-22T03:00:32.153 INFO:teuthology.task.install:Using flavor: crimson 2024-09-22T03:00:32.158 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-22T03:00:32.158 INFO:teuthology.task.install:extra packages: [] 2024-09-22T03:00:32.158 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'tag': None, 'wait_for_package': False} 2024-09-22T03:00:32.159 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T03:00:32.160 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'tag': None, 'wait_for_package': False} 2024-09-22T03:00:32.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T03:00:32.304 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/ 2024-09-22T03:00:32.304 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-22T03:00:32.308 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/ 2024-09-22T03:00:32.308 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-22T03:00:32.414 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T03:00:32.414 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:00:32.414 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T03:00:32.419 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T03:00:32.420 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:00:32.420 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T03:00:32.440 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-22T03:00:32.440 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e45e6b490e6cbe082cdf155fea780438ec53fc7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T03:00:32.445 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-22T03:00:32.446 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e45e6b490e6cbe082cdf155fea780438ec53fc7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T03:00:32.506 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T03:00:32.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T03:00:32.581 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T03:00:32.586 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T03:00:32.645 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2024-09-22T03:00:32.647 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2024-09-22T03:00:32.651 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-09-22T03:00:32.652 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-09-22T03:00:32.874 INFO:teuthology.orchestra.run.smithi139.stdout:45 files removed 2024-09-22T03:00:32.886 INFO:teuthology.orchestra.run.smithi134.stdout:45 files removed 2024-09-22T03:00:32.901 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw 2024-09-22T03:00:32.913 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw 2024-09-22T03:00:33.452 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 322 kB/s | 87 kB 00:00 2024-09-22T03:00:33.464 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 330 kB/s | 87 kB 00:00 2024-09-22T03:00:33.728 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-22T03:00:33.756 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-22T03:00:34.004 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 8.3 kB/s | 2.0 kB 00:00 2024-09-22T03:00:34.031 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 8.3 kB/s | 2.0 kB 00:00 2024-09-22T03:00:34.565 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-22T03:00:35.913 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-22T03:00:37.988 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-22T03:00:38.616 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 6.9 MB/s | 20 MB 00:02 2024-09-22T03:00:42.289 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-22T03:00:42.816 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-22T03:00:43.989 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-22T03:00:44.334 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-22T03:00:45.352 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-22T03:00:45.488 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-22T03:00:50.758 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-22T03:00:50.860 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-22T03:00:52.958 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:00:52.968 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:00:52.968 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-22T03:00:52.968 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:00:52.968 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:00:52.968 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 9.9 M 2024-09-22T03:00:52.968 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 19 M 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 760 k 2024-09-22T03:00:52.969 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 501 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.1 M 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 161 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-22T03:00:52.970 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 301 k 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout:Installing weak dependencies: 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout:Install 30 Packages 2024-09-22T03:00:52.971 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 2 Packages 2024-09-22T03:00:52.972 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:00:52.972 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 58 M 2024-09-22T03:00:52.972 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:00:53.078 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:00:53.114 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:00:53.114 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-22T03:00:53.114 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 9.9 M 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 19 M 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T03:00:53.115 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 760 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 501 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.1 M 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 161 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-22T03:00:53.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 301 k 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout:Install 30 Packages 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2024-09-22T03:00:53.117 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:00:53.118 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 58 M 2024-09-22T03:00:53.118 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:00:53.550 INFO:teuthology.orchestra.run.smithi139.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 11 MB/s | 5.4 MB 00:00 2024-09-22T03:00:53.609 INFO:teuthology.orchestra.run.smithi139.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 432 kB/s | 25 kB 00:00 2024-09-22T03:00:53.709 INFO:teuthology.orchestra.run.smithi139.stdout:(3/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 7.4 MB/s | 760 kB 00:00 2024-09-22T03:00:53.818 INFO:teuthology.orchestra.run.smithi139.stdout:(4/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 4.5 MB/s | 501 kB 00:00 2024-09-22T03:00:53.935 INFO:teuthology.orchestra.run.smithi139.stdout:(5/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 11 MB/s | 9.9 MB 00:00 2024-09-22T03:00:53.985 INFO:teuthology.orchestra.run.smithi139.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 908 kB/s | 45 kB 00:00 2024-09-22T03:00:54.177 INFO:teuthology.orchestra.run.smithi139.stdout:(7/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x8 17 MB/s | 19 MB 00:01 2024-09-22T03:00:54.203 INFO:teuthology.orchestra.run.smithi139.stdout:(8/32): python3-ceph-common-19.1.1-373.g4e45e6b 628 kB/s | 136 kB 00:00 2024-09-22T03:00:54.278 INFO:teuthology.orchestra.run.smithi139.stdout:(9/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_64 11 MB/s | 5.1 MB 00:00 2024-09-22T03:00:54.308 INFO:teuthology.orchestra.run.smithi139.stdout:(10/32): python3-cephfs-19.1.1-373.g4e45e6b4.el 1.3 MB/s | 161 kB 00:00 2024-09-22T03:00:54.340 INFO:teuthology.orchestra.run.smithi139.stdout:(11/32): python3-rados-19.1.1-373.g4e45e6b4.el9 2.3 MB/s | 321 kB 00:00 2024-09-22T03:00:54.364 INFO:teuthology.orchestra.run.smithi139.stdout:(12/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 3.5 MB/s | 301 kB 00:00 2024-09-22T03:00:54.392 INFO:teuthology.orchestra.run.smithi139.stdout:(13/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.2 MB/s | 99 kB 00:00 2024-09-22T03:00:54.488 INFO:teuthology.orchestra.run.smithi139.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-09-22T03:00:54.513 INFO:teuthology.orchestra.run.smithi139.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 609 kB/s | 107 kB 00:00 2024-09-22T03:00:54.538 INFO:teuthology.orchestra.run.smithi139.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 912 kB/s | 160 kB 00:00 2024-09-22T03:00:54.588 INFO:teuthology.orchestra.run.smithi139.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-22T03:00:54.613 INFO:teuthology.orchestra.run.smithi139.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-22T03:00:54.628 INFO:teuthology.orchestra.run.smithi134.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 3.8 MB/s | 5.4 MB 00:01 2024-09-22T03:00:54.647 INFO:teuthology.orchestra.run.smithi139.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-22T03:00:54.672 INFO:teuthology.orchestra.run.smithi139.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 614 kB/s | 36 kB 00:00 2024-09-22T03:00:54.673 INFO:teuthology.orchestra.run.smithi134.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 606 kB/s | 25 kB 00:00 2024-09-22T03:00:54.697 INFO:teuthology.orchestra.run.smithi139.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-22T03:00:54.731 INFO:teuthology.orchestra.run.smithi139.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-22T03:00:54.779 INFO:teuthology.orchestra.run.smithi134.stdout:(3/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 6.9 MB/s | 760 kB 00:00 2024-09-22T03:00:54.806 INFO:teuthology.orchestra.run.smithi139.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.2 MB/s | 308 kB 00:00 2024-09-22T03:00:54.832 INFO:teuthology.orchestra.run.smithi139.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 304 kB/s | 26 kB 00:00 2024-09-22T03:00:54.857 INFO:teuthology.orchestra.run.smithi139.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 963 kB/s | 49 kB 00:00 2024-09-22T03:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout:(4/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 5.4 MB/s | 501 kB 00:00 2024-09-22T03:00:54.882 INFO:teuthology.orchestra.run.smithi139.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-22T03:00:54.924 INFO:teuthology.orchestra.run.smithi139.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-22T03:00:54.958 INFO:teuthology.orchestra.run.smithi139.stdout:(28/32): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-22T03:00:54.979 INFO:teuthology.orchestra.run.smithi134.stdout:(5/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 5.6 MB/s | 9.9 MB 00:01 2024-09-22T03:00:55.040 INFO:teuthology.orchestra.run.smithi134.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 777 kB/s | 45 kB 00:00 2024-09-22T03:00:55.050 INFO:teuthology.orchestra.run.smithi139.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-22T03:00:55.105 INFO:teuthology.orchestra.run.smithi134.stdout:(7/32): python3-ceph-common-19.1.1-373.g4e45e6b 2.0 MB/s | 136 kB 00:00 2024-09-22T03:00:55.175 INFO:teuthology.orchestra.run.smithi139.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-09-22T03:00:55.181 INFO:teuthology.orchestra.run.smithi134.stdout:(8/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 2.1 MB/s | 161 kB 00:00 2024-09-22T03:00:55.242 INFO:teuthology.orchestra.run.smithi139.stdout:(31/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-22T03:00:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:(9/32): python3-rados-19.1.1-373.g4e45e6b4.el9. 3.4 MB/s | 321 kB 00:00 2024-09-22T03:00:55.350 INFO:teuthology.orchestra.run.smithi139.stdout:(32/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 10 MB/s | 3.1 MB 00:00 2024-09-22T03:00:55.356 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:00:55.356 INFO:teuthology.orchestra.run.smithi139.stdout:Total 24 MB/s | 58 MB 00:02 2024-09-22T03:00:55.381 INFO:teuthology.orchestra.run.smithi134.stdout:(10/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 2.7 MB/s | 301 kB 00:00 2024-09-22T03:00:55.463 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:00:55.464 INFO:teuthology.orchestra.run.smithi134.stdout:(11/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_6 8.6 MB/s | 5.1 MB 00:00 2024-09-22T03:00:55.490 INFO:teuthology.orchestra.run.smithi134.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 915 kB/s | 99 kB 00:00 2024-09-22T03:00:55.499 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:00:55.499 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:00:55.598 INFO:teuthology.orchestra.run.smithi134.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 801 kB/s | 107 kB 00:00 2024-09-22T03:00:55.640 INFO:teuthology.orchestra.run.smithi134.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-22T03:00:55.665 INFO:teuthology.orchestra.run.smithi134.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 913 kB/s | 160 kB 00:00 2024-09-22T03:00:55.782 INFO:teuthology.orchestra.run.smithi134.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-22T03:00:55.974 INFO:teuthology.orchestra.run.smithi134.stdout:(17/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x 7.0 MB/s | 19 MB 00:02 2024-09-22T03:00:55.999 INFO:teuthology.orchestra.run.smithi134.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 195 kB/s | 42 kB 00:00 2024-09-22T03:00:56.025 INFO:teuthology.orchestra.run.smithi134.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.7 MB/s | 662 kB 00:00 2024-09-22T03:00:56.050 INFO:teuthology.orchestra.run.smithi134.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-09-22T03:00:56.075 INFO:teuthology.orchestra.run.smithi134.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-22T03:00:56.134 INFO:teuthology.orchestra.run.smithi134.stdout:(22/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.6 MB/s | 308 kB 00:00 2024-09-22T03:00:56.159 INFO:teuthology.orchestra.run.smithi134.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-22T03:00:56.190 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:00:56.191 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:00:56.201 INFO:teuthology.orchestra.run.smithi134.stdout:(24/32): qatlib-24.02.0-1.el9.x86_64.rpm 976 kB/s | 221 kB 00:00 2024-09-22T03:00:56.226 INFO:teuthology.orchestra.run.smithi134.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2024-09-22T03:00:56.276 INFO:teuthology.orchestra.run.smithi134.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 897 kB/s | 67 kB 00:00 2024-09-22T03:00:56.318 INFO:teuthology.orchestra.run.smithi134.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-22T03:00:56.369 INFO:teuthology.orchestra.run.smithi134.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-22T03:00:56.469 INFO:teuthology.orchestra.run.smithi134.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-22T03:00:56.519 INFO:teuthology.orchestra.run.smithi134.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-09-22T03:00:56.902 INFO:teuthology.orchestra.run.smithi134.stdout:(31/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 7.2 MB/s | 3.1 MB 00:00 2024-09-22T03:00:56.962 INFO:teuthology.orchestra.run.smithi134.stdout:(32/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 5.4 MB/s | 3.2 MB 00:00 2024-09-22T03:00:56.966 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:00:56.966 INFO:teuthology.orchestra.run.smithi134.stdout:Total 15 MB/s | 58 MB 00:03 2024-09-22T03:00:57.069 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:00:57.105 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:00:57.105 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:00:57.628 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:00:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-22T03:00:58.136 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T03:00:58.228 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T03:00:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-22T03:00:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T03:00:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T03:00:58.458 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/34 2024-09-22T03:00:58.492 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/34 2024-09-22T03:00:58.514 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 7/34 2024-09-22T03:00:58.536 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 7/34 2024-09-22T03:00:58.743 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 8/34 2024-09-22T03:00:58.770 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 8/34 2024-09-22T03:00:58.799 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/34 2024-09-22T03:00:58.843 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 10/34 2024-09-22T03:00:58.872 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-22T03:00:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 12/34 2024-09-22T03:00:58.960 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T03:00:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T03:00:59.084 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.15.0-2.el9.x86_64 14/34 2024-09-22T03:00:59.193 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-22T03:00:59.227 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-22T03:00:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:00:59.268 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-22T03:00:59.309 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-22T03:00:59.338 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-22T03:00:59.371 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-22T03:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-22T03:00:59.710 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-22T03:00:59.738 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T03:00:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-22T03:00:59.835 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T03:00:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-22T03:00:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-22T03:00:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-22T03:00:59.937 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-22T03:00:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T03:01:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T03:01:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/34 2024-09-22T03:01:00.111 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/34 2024-09-22T03:01:00.133 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 7/34 2024-09-22T03:01:00.175 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 7/34 2024-09-22T03:01:00.319 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 8/34 2024-09-22T03:01:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 8/34 2024-09-22T03:01:00.385 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/34 2024-09-22T03:01:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-22T03:01:00.427 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-22T03:01:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 10/34 2024-09-22T03:01:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-22T03:01:00.498 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-22T03:01:00.551 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 12/34 2024-09-22T03:01:00.575 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-22T03:01:00.588 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T03:01:00.613 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-22T03:01:00.677 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T03:01:00.712 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 14/34 2024-09-22T03:01:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-22T03:01:00.863 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-22T03:01:00.904 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-22T03:01:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-22T03:01:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-22T03:01:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-22T03:01:01.337 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-22T03:01:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-22T03:01:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-22T03:01:01.499 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-22T03:01:01.535 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-22T03:01:02.025 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-22T03:01:02.046 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-22T03:01:02.110 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-22T03:01:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-22T03:01:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-22T03:01:02.868 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T03:01:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T03:01:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T03:01:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-22T03:01:03.611 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-22T03:01:03.611 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T03:01:03.611 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T03:01:03.611 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:01:03.646 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T03:01:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T03:01:04.520 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T03:01:05.095 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T03:01:05.140 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-22T03:01:05.233 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-22T03:01:05.233 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T03:01:05.233 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T03:01:05.233 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:01:05.274 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T03:01:13.646 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T03:01:13.646 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2024-09-22T03:01:13.646 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2024-09-22T03:01:13.646 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2024-09-22T03:01:13.646 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2024-09-22T03:01:13.646 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2024-09-22T03:01:13.646 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /root 2024-09-22T03:01:13.646 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2024-09-22T03:01:13.647 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:01:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-22T03:01:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-22T03:01:14.670 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:14.670 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T03:01:14.670 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:01:14.670 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:01:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:01:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-22T03:01:14.764 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-22T03:01:14.764 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:01:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T03:01:15.419 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-09-22T03:01:15.419 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-09-22T03:01:15.419 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-09-22T03:01:15.419 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-09-22T03:01:15.419 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-09-22T03:01:15.419 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-09-22T03:01:15.420 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-09-22T03:01:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:01:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:01:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-22T03:01:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T03:01:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-22T03:01:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T03:01:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-22T03:01:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-22T03:01:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-22T03:01:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-22T03:01:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-22T03:01:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-22T03:01:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-22T03:01:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-22T03:01:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T03:01:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-22T03:01:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-22T03:01:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-22T03:01:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-22T03:01:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-22T03:01:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-22T03:01:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-22T03:01:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-22T03:01:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-22T03:01:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-22T03:01:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-22T03:01:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-22T03:01:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-22T03:01:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-22T03:01:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-22T03:01:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-22T03:01:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-22T03:01:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T03:01:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-22T03:01:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-22T03:01:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-22T03:01:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-22T03:01:16.356 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:16.356 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T03:01:16.356 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:01:16.356 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:01:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:01:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-22T03:01:16.433 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-22T03:01:16.433 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:01:17.037 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:01:17.037 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:01:17.037 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T03:01:17.038 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.039 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.040 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:17.040 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T03:01:17.040 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T03:01:17.040 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T03:01:17.040 INFO:teuthology.orchestra.run.smithi139.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T03:01:17.040 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T03:01:17.040 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:01:17.040 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:01:17.374 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-test 2024-09-22T03:01:17.663 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:01:17.663 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-22T03:01:17.663 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-22T03:01:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-22T03:01:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-22T03:01:17.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T03:01:17.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-22T03:01:17.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-22T03:01:17.956 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:27 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:01:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:01:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:01:18.098 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-22T03:01:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:01:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:01:18.098 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 124 M 2024-09-22T03:01:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-22T03:01:18.098 INFO:teuthology.orchestra.run.smithi139.stdout: libasan x86_64 11.5.0-2.el9 appstream 414 k 2024-09-22T03:01:18.099 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 158 k 2024-09-22T03:01:18.099 INFO:teuthology.orchestra.run.smithi139.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-22T03:01:18.099 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T03:01:18.099 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T03:01:18.099 INFO:teuthology.orchestra.run.smithi139.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-22T03:01:18.099 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:01:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:01:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:01:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:Install 7 Packages 2024-09-22T03:01:18.099 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:01:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 125 M 2024-09-22T03:01:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 1.1 G 2024-09-22T03:01:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:01:18.736 INFO:teuthology.orchestra.run.smithi139.stdout:(1/7): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 721 kB/s | 158 kB 00:00 2024-09-22T03:01:18.807 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T03:01:18.808 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T03:01:18.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:18.810 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T03:01:18.810 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T03:01:18.810 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T03:01:18.810 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T03:01:18.810 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T03:01:18.810 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:01:18.810 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:01:19.028 INFO:teuthology.orchestra.run.smithi139.stdout:(2/7): libasan-11.5.0-2.el9.x86_64.rpm 811 kB/s | 414 kB 00:00 2024-09-22T03:01:19.119 INFO:teuthology.orchestra.run.smithi139.stdout:(3/7): libubsan-11.5.0-2.el9.x86_64.rpm 476 kB/s | 183 kB 00:00 2024-09-22T03:01:19.146 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-test 2024-09-22T03:01:19.195 INFO:teuthology.orchestra.run.smithi139.stdout:(4/7): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-09-22T03:01:19.253 INFO:teuthology.orchestra.run.smithi139.stdout:(5/7): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.0 MB/s | 122 kB 00:00 2024-09-22T03:01:19.362 INFO:teuthology.orchestra.run.smithi139.stdout:(6/7): xmlstarlet-1.6.1-20.el9.x86_64.rpm 263 kB/s | 64 kB 00:00 2024-09-22T03:01:19.726 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:29 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:01:19.858 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 124 M 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: libasan x86_64 11.5.0-2.el9 appstream 414 k 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 158 k 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T03:01:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-22T03:01:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:01:19.860 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:01:19.860 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:01:19.860 INFO:teuthology.orchestra.run.smithi134.stdout:Install 7 Packages 2024-09-22T03:01:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:01:19.860 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 125 M 2024-09-22T03:01:19.860 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 1.1 G 2024-09-22T03:01:19.861 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:01:20.421 INFO:teuthology.orchestra.run.smithi134.stdout:(1/7): libasan-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 414 kB 00:00 2024-09-22T03:01:20.463 INFO:teuthology.orchestra.run.smithi134.stdout:(2/7): libubsan-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 183 kB 00:00 2024-09-22T03:01:20.513 INFO:teuthology.orchestra.run.smithi134.stdout:(3/7): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-22T03:01:20.547 INFO:teuthology.orchestra.run.smithi134.stdout:(4/7): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-22T03:01:20.597 INFO:teuthology.orchestra.run.smithi134.stdout:(5/7): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.4 MB/s | 122 kB 00:00 2024-09-22T03:01:20.697 INFO:teuthology.orchestra.run.smithi134.stdout:(6/7): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 374 kB/s | 158 kB 00:00 2024-09-22T03:01:21.937 INFO:teuthology.orchestra.run.smithi139.stdout:(7/7): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 36 MB/s | 124 MB 00:03 2024-09-22T03:01:21.939 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:21.940 INFO:teuthology.orchestra.run.smithi139.stdout:Total 33 MB/s | 125 MB 00:03 2024-09-22T03:01:21.993 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:01:22.014 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:01:22.014 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:01:22.833 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:01:22.833 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:01:23.898 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:01:23.969 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/7 2024-09-22T03:01:24.012 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/7 2024-09-22T03:01:24.052 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/7 2024-09-22T03:01:24.096 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 4/7 2024-09-22T03:01:24.145 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libasan-11.5.0-2.el9.x86_64 5/7 2024-09-22T03:01:24.173 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/7 2024-09-22T03:01:24.214 INFO:teuthology.orchestra.run.smithi134.stdout:(7/7): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 32 MB/s | 124 MB 00:03 2024-09-22T03:01:24.217 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:24.217 INFO:teuthology.orchestra.run.smithi134.stdout:Total 29 MB/s | 125 MB 00:04 2024-09-22T03:01:24.272 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:01:24.293 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:01:24.293 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:01:25.114 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:01:25.114 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:01:26.192 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:01:26.262 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/7 2024-09-22T03:01:26.306 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/7 2024-09-22T03:01:26.342 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/7 2024-09-22T03:01:26.373 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 4/7 2024-09-22T03:01:26.414 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libasan-11.5.0-2.el9.x86_64 5/7 2024-09-22T03:01:26.441 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/7 2024-09-22T03:01:41.298 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/7 2024-09-22T03:01:41.378 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/7 2024-09-22T03:01:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/7 2024-09-22T03:01:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/7 2024-09-22T03:01:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/7 2024-09-22T03:01:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/7 2024-09-22T03:01:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/7 2024-09-22T03:01:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libasan-11.5.0-2.el9.x86_64 3/7 2024-09-22T03:01:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 4/7 2024-09-22T03:01:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 5/7 2024-09-22T03:01:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/7 2024-09-22T03:01:49.898 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 7/7 2024-09-22T03:01:49.898 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:01:49.898 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:01:49.898 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:49.898 INFO:teuthology.orchestra.run.smithi139.stdout: libasan-11.5.0-2.el9.x86_64 2024-09-22T03:01:49.898 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:49.898 INFO:teuthology.orchestra.run.smithi139.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-22T03:01:49.899 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T03:01:49.899 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T03:01:49.899 INFO:teuthology.orchestra.run.smithi139.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-22T03:01:49.899 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:01:49.899 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:01:50.217 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph 2024-09-22T03:01:50.800 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:00 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:01:50.935 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:01:50.937 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:01:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-22T03:01:50.937 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.3 M 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.9 M 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 120 M 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T03:01:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T03:01:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T03:01:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T03:01:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T03:01:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T03:01:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:01:50.941 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:01:50.941 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:01:50.941 INFO:teuthology.orchestra.run.smithi139.stdout:Install 38 Packages 2024-09-22T03:01:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:01:50.941 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 134 M 2024-09-22T03:01:50.942 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 1.4 G 2024-09-22T03:01:50.942 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:01:51.624 INFO:teuthology.orchestra.run.smithi139.stdout:(1/38): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 48 kB/s | 6.6 kB 00:00 2024-09-22T03:01:51.790 INFO:teuthology.orchestra.run.smithi139.stdout:(2/38): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 5.0 MB/s | 1.5 MB 00:00 2024-09-22T03:01:51.866 INFO:teuthology.orchestra.run.smithi139.stdout:(3/38): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 6.0 MB/s | 2.3 MB 00:00 2024-09-22T03:01:51.916 INFO:teuthology.orchestra.run.smithi139.stdout:(4/38): ceph-mgr-modules-core-19.1.1-373.g4e45e 4.9 MB/s | 249 kB 00:00 2024-09-22T03:01:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/7 2024-09-22T03:01:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/7 2024-09-22T03:01:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/7 2024-09-22T03:01:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libasan-11.5.0-2.el9.x86_64 3/7 2024-09-22T03:01:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 4/7 2024-09-22T03:01:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 5/7 2024-09-22T03:01:52.001 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/7 2024-09-22T03:01:52.050 INFO:teuthology.orchestra.run.smithi139.stdout:(5/38): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 11 MB/s | 4.9 MB 00:00 2024-09-22T03:01:52.133 INFO:teuthology.orchestra.run.smithi139.stdout:(6/38): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-22T03:01:52.183 INFO:teuthology.orchestra.run.smithi139.stdout:(7/38): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-22T03:01:52.259 INFO:teuthology.orchestra.run.smithi139.stdout:(8/38): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-09-22T03:01:52.334 INFO:teuthology.orchestra.run.smithi139.stdout:(9/38): python3-requests-2.25.1-8.el9.noarch.rp 1.6 MB/s | 125 kB 00:00 2024-09-22T03:01:52.404 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 7/7 2024-09-22T03:01:52.405 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:01:52.405 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:01:52.405 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:52.405 INFO:teuthology.orchestra.run.smithi134.stdout: libasan-11.5.0-2.el9.x86_64 2024-09-22T03:01:52.405 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:52.405 INFO:teuthology.orchestra.run.smithi134.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-22T03:01:52.405 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T03:01:52.405 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T03:01:52.405 INFO:teuthology.orchestra.run.smithi134.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-22T03:01:52.405 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:01:52.405 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:01:52.426 INFO:teuthology.orchestra.run.smithi139.stdout:(10/38): python3-urllib3-1.26.5-6.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-09-22T03:01:52.651 INFO:teuthology.orchestra.run.smithi139.stdout:(11/38): python3-cryptography-36.0.1-4.el9.x86_ 2.0 MB/s | 1.2 MB 00:00 2024-09-22T03:01:52.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph 2024-09-22T03:01:53.168 INFO:teuthology.orchestra.run.smithi139.stdout:(12/38): lua-5.4.4-4.el9.x86_64.rpm 254 kB/s | 188 kB 00:00 2024-09-22T03:01:53.328 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:03 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:01:53.471 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:01:53.473 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:01:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.3 M 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.9 M 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 120 M 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T03:01:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T03:01:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T03:01:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T03:01:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T03:01:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:01:53.477 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:01:53.477 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:01:53.477 INFO:teuthology.orchestra.run.smithi134.stdout:Install 38 Packages 2024-09-22T03:01:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:01:53.477 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 134 M 2024-09-22T03:01:53.478 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 1.4 G 2024-09-22T03:01:53.478 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:01:53.577 INFO:teuthology.orchestra.run.smithi139.stdout:(13/38): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-22T03:01:53.877 INFO:teuthology.orchestra.run.smithi139.stdout:(14/38): python3-mako-1.1.4-6.el9.noarch.rpm 243 kB/s | 172 kB 00:00 2024-09-22T03:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout:(15/38): python3-markupsafe-1.1.1-12.el9.x86_64 60 kB/s | 35 kB 00:00 2024-09-22T03:01:54.284 INFO:teuthology.orchestra.run.smithi134.stdout:(1/38): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 39 kB/s | 6.6 kB 00:00 2024-09-22T03:01:54.452 INFO:teuthology.orchestra.run.smithi134.stdout:(2/38): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 4.5 MB/s | 1.5 MB 00:00 2024-09-22T03:01:54.543 INFO:teuthology.orchestra.run.smithi134.stdout:(3/38): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 5.3 MB/s | 2.3 MB 00:00 2024-09-22T03:01:54.602 INFO:teuthology.orchestra.run.smithi134.stdout:(4/38): ceph-mgr-modules-core-19.1.1-373.g4e45e 4.2 MB/s | 249 kB 00:00 2024-09-22T03:01:54.727 INFO:teuthology.orchestra.run.smithi134.stdout:(5/38): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 11 MB/s | 4.9 MB 00:00 2024-09-22T03:01:55.186 INFO:teuthology.orchestra.run.smithi139.stdout:(16/38): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_ 35 MB/s | 120 MB 00:03 2024-09-22T03:01:55.361 INFO:teuthology.orchestra.run.smithi134.stdout:(6/38): python3-cffi-1.14.5-5.el9.x86_64.rpm 334 kB/s | 253 kB 00:00 2024-09-22T03:01:55.453 INFO:teuthology.orchestra.run.smithi139.stdout:(17/38): python3-packaging-20.9-5.el9.noarch.rp 49 kB/s | 77 kB 00:01 2024-09-22T03:01:55.478 INFO:teuthology.orchestra.run.smithi134.stdout:(7/38): python3-ply-3.11-14.el9.noarch.rpm 915 kB/s | 106 kB 00:00 2024-09-22T03:01:55.511 INFO:teuthology.orchestra.run.smithi139.stdout:(18/38): lua-devel-5.4.4-4.el9.x86_64.rpm 384 kB/s | 22 kB 00:00 2024-09-22T03:01:55.545 INFO:teuthology.orchestra.run.smithi134.stdout:(8/38): python3-cryptography-36.0.1-4.el9.x86_6 1.5 MB/s | 1.2 MB 00:00 2024-09-22T03:01:55.561 INFO:teuthology.orchestra.run.smithi139.stdout:(19/38): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-22T03:01:55.587 INFO:teuthology.orchestra.run.smithi139.stdout:(20/38): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-22T03:01:55.595 INFO:teuthology.orchestra.run.smithi134.stdout:(9/38): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-22T03:01:55.629 INFO:teuthology.orchestra.run.smithi139.stdout:(21/38): python3-cheroot-8.6.0-4.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-22T03:01:55.654 INFO:teuthology.orchestra.run.smithi134.stdout:(10/38): python3-requests-2.25.1-8.el9.noarch.r 1.1 MB/s | 125 kB 00:00 2024-09-22T03:01:55.704 INFO:teuthology.orchestra.run.smithi139.stdout:(22/38): python3-cherrypy-18.6.1-2.el9.noarch.r 4.7 MB/s | 358 kB 00:00 2024-09-22T03:01:55.712 INFO:teuthology.orchestra.run.smithi134.stdout:(11/38): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-22T03:01:55.721 INFO:teuthology.orchestra.run.smithi139.stdout:(23/38): python3-jaraco-8.2.1-3.el9.noarch.rpm 650 kB/s | 11 kB 00:00 2024-09-22T03:01:55.738 INFO:teuthology.orchestra.run.smithi139.stdout:(24/38): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-22T03:01:55.755 INFO:teuthology.orchestra.run.smithi139.stdout:(25/38): python3-pytz-2021.1-5.el9.noarch.rpm 32 kB/s | 51 kB 00:01 2024-09-22T03:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout:(26/38): python3-toml-0.10.2-6.el9.noarch.rpm 71 kB/s | 42 kB 00:00 2024-09-22T03:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout:(27/38): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-22T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout:(12/38): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-22T03:01:55.822 INFO:teuthology.orchestra.run.smithi139.stdout:(28/38): python3-logutils-0.3.5-21.el9.noarch.r 2.5 MB/s | 46 kB 00:00 2024-09-22T03:01:55.839 INFO:teuthology.orchestra.run.smithi139.stdout:(29/38): python3-jaraco-functools-3.5.0-2.el9.n 290 kB/s | 19 kB 00:00 2024-09-22T03:01:55.856 INFO:teuthology.orchestra.run.smithi139.stdout:(30/38): python3-jaraco-text-3.2.0-6.el9.noarch 235 kB/s | 20 kB 00:00 2024-09-22T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout:(13/38): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-22T03:01:55.881 INFO:teuthology.orchestra.run.smithi139.stdout:(31/38): python3-more-itertools-8.12.0-2.el9.no 1.4 MB/s | 79 kB 00:00 2024-09-22T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout:(14/38): python3-markupsafe-1.1.1-12.el9.x86_64 1.0 MB/s | 35 kB 00:00 2024-09-22T03:01:55.906 INFO:teuthology.orchestra.run.smithi139.stdout:(32/38): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-22T03:01:55.932 INFO:teuthology.orchestra.run.smithi139.stdout:(33/38): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-22T03:01:55.938 INFO:teuthology.orchestra.run.smithi134.stdout:(15/38): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-09-22T03:01:55.957 INFO:teuthology.orchestra.run.smithi139.stdout:(34/38): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2024-09-22T03:01:55.963 INFO:teuthology.orchestra.run.smithi134.stdout:(16/38): python3-packaging-20.9-5.el9.noarch.rp 1.3 MB/s | 77 kB 00:00 2024-09-22T03:01:55.980 INFO:teuthology.orchestra.run.smithi134.stdout:(17/38): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-22T03:01:55.991 INFO:teuthology.orchestra.run.smithi139.stdout:(35/38): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-22T03:01:55.997 INFO:teuthology.orchestra.run.smithi134.stdout:(18/38): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-22T03:01:56.016 INFO:teuthology.orchestra.run.smithi139.stdout:(36/38): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-22T03:01:56.041 INFO:teuthology.orchestra.run.smithi139.stdout:(37/38): python3-zc-lockfile-2.0-10.el9.noarch. 400 kB/s | 20 kB 00:00 2024-09-22T03:01:56.055 INFO:teuthology.orchestra.run.smithi134.stdout:(19/38): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-22T03:01:56.073 INFO:teuthology.orchestra.run.smithi134.stdout:(20/38): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-22T03:01:56.083 INFO:teuthology.orchestra.run.smithi139.stdout:(38/38): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-09-22T03:01:56.089 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:56.089 INFO:teuthology.orchestra.run.smithi139.stdout:Total 26 MB/s | 134 MB 00:05 2024-09-22T03:01:56.098 INFO:teuthology.orchestra.run.smithi134.stdout:(21/38): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-22T03:01:56.173 INFO:teuthology.orchestra.run.smithi134.stdout:(22/38): python3-cherrypy-18.6.1-2.el9.noarch.r 5.2 MB/s | 358 kB 00:00 2024-09-22T03:01:56.199 INFO:teuthology.orchestra.run.smithi134.stdout:(23/38): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-22T03:01:56.224 INFO:teuthology.orchestra.run.smithi134.stdout:(24/38): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2024-09-22T03:01:56.250 INFO:teuthology.orchestra.run.smithi134.stdout:(25/38): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-09-22T03:01:56.257 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:01:56.274 INFO:teuthology.orchestra.run.smithi134.stdout:(26/38): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-22T03:01:56.291 INFO:teuthology.orchestra.run.smithi134.stdout:(27/38): python3-jaraco-functools-3.5.0-2.el9.n 466 kB/s | 19 kB 00:00 2024-09-22T03:01:56.298 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:01:56.298 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:01:56.308 INFO:teuthology.orchestra.run.smithi134.stdout:(28/38): python3-jaraco-text-3.2.0-6.el9.noarch 585 kB/s | 20 kB 00:00 2024-09-22T03:01:56.334 INFO:teuthology.orchestra.run.smithi134.stdout:(29/38): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-09-22T03:01:56.359 INFO:teuthology.orchestra.run.smithi134.stdout:(30/38): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-22T03:01:56.376 INFO:teuthology.orchestra.run.smithi134.stdout:(31/38): python3-portend-3.1.0-2.el9.noarch.rpm 987 kB/s | 16 kB 00:00 2024-09-22T03:01:56.402 INFO:teuthology.orchestra.run.smithi134.stdout:(32/38): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-22T03:01:56.426 INFO:teuthology.orchestra.run.smithi134.stdout:(33/38): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-22T03:01:56.452 INFO:teuthology.orchestra.run.smithi134.stdout:(34/38): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-09-22T03:01:56.477 INFO:teuthology.orchestra.run.smithi134.stdout:(35/38): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-22T03:01:56.494 INFO:teuthology.orchestra.run.smithi134.stdout:(36/38): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-22T03:01:56.527 INFO:teuthology.orchestra.run.smithi134.stdout:(37/38): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-22T03:01:57.366 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:01:57.367 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:01:58.169 INFO:teuthology.orchestra.run.smithi134.stdout:(38/38): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_ 32 MB/s | 120 MB 00:03 2024-09-22T03:01:58.174 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:58.174 INFO:teuthology.orchestra.run.smithi134.stdout:Total 29 MB/s | 134 MB 00:04 2024-09-22T03:01:58.339 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:01:58.380 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:01:58.380 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:01:59.372 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/38 2024-09-22T03:01:59.481 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:01:59.482 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:01:59.493 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/38 2024-09-22T03:01:59.521 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/38 2024-09-22T03:01:59.600 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/38 2024-09-22T03:01:59.645 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/38 2024-09-22T03:01:59.677 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/38 2024-09-22T03:01:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/38 2024-09-22T03:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/38 2024-09-22T03:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/38 2024-09-22T03:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/38 2024-09-22T03:01:59.961 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/38 2024-09-22T03:01:59.996 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/38 2024-09-22T03:02:00.029 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/38 2024-09-22T03:02:00.070 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/38 2024-09-22T03:02:00.105 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/38 2024-09-22T03:02:00.139 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/38 2024-09-22T03:02:00.188 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/38 2024-09-22T03:02:00.219 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/38 2024-09-22T03:02:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/38 2024-09-22T03:02:00.449 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/38 2024-09-22T03:02:00.499 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/38 2024-09-22T03:02:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:02:01.538 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/38 2024-09-22T03:02:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/38 2024-09-22T03:02:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/38 2024-09-22T03:02:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/38 2024-09-22T03:02:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/38 2024-09-22T03:02:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/38 2024-09-22T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/38 2024-09-22T03:02:01.967 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/38 2024-09-22T03:02:02.007 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/38 2024-09-22T03:02:02.042 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/38 2024-09-22T03:02:02.072 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/38 2024-09-22T03:02:02.098 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/38 2024-09-22T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/38 2024-09-22T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/38 2024-09-22T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/38 2024-09-22T03:02:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/38 2024-09-22T03:02:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/38 2024-09-22T03:02:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/38 2024-09-22T03:02:02.394 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/38 2024-09-22T03:02:02.535 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/38 2024-09-22T03:02:02.585 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/38 2024-09-22T03:02:19.405 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/38 2024-09-22T03:02:19.504 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/38 2024-09-22T03:02:19.533 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/38 2024-09-22T03:02:19.533 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:19.533 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T03:02:19.534 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:02:19.534 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:02:19.534 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:19.637 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/38 2024-09-22T03:02:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/38 2024-09-22T03:02:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ply-3.11-14.el9.noarch 26/38 2024-09-22T03:02:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 27/38 2024-09-22T03:02:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 28/38 2024-09-22T03:02:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 29/38 2024-09-22T03:02:20.119 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/38 2024-09-22T03:02:20.207 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 31/38 2024-09-22T03:02:20.255 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 32/38 2024-09-22T03:02:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 33/38 2024-09-22T03:02:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 34/38 2024-09-22T03:02:20.582 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/38 2024-09-22T03:02:20.608 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/38 2024-09-22T03:02:20.608 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:20.608 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T03:02:20.608 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:02:20.608 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:02:20.608 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:21.099 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/38 2024-09-22T03:02:21.123 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/38 2024-09-22T03:02:21.124 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:21.124 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T03:02:21.124 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:02:21.124 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:02:21.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:21.358 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/38 2024-09-22T03:02:21.382 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/38 2024-09-22T03:02:21.382 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:21.382 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T03:02:21.382 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:02:21.382 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:02:21.383 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:21.446 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 38/38 2024-09-22T03:02:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/38 2024-09-22T03:02:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/38 2024-09-22T03:02:21.547 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/38 2024-09-22T03:02:21.547 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:21.547 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T03:02:21.547 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:02:21.547 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:02:21.547 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:21.651 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/38 2024-09-22T03:02:21.689 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/38 2024-09-22T03:02:21.746 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 26/38 2024-09-22T03:02:21.802 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 27/38 2024-09-22T03:02:22.000 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 28/38 2024-09-22T03:02:22.051 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 29/38 2024-09-22T03:02:22.129 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/38 2024-09-22T03:02:22.218 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 31/38 2024-09-22T03:02:22.250 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 32/38 2024-09-22T03:02:22.368 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 33/38 2024-09-22T03:02:22.534 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 34/38 2024-09-22T03:02:22.561 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/38 2024-09-22T03:02:22.584 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/38 2024-09-22T03:02:22.584 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:22.584 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T03:02:22.584 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:02:22.584 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:02:22.585 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/38 2024-09-22T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/38 2024-09-22T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:23.303 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/38 2024-09-22T03:02:23.327 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/38 2024-09-22T03:02:23.327 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:23.327 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T03:02:23.327 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:02:23.327 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:02:23.327 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:23.392 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 38/38 2024-09-22T03:02:31.614 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 38/38 2024-09-22T03:02:31.614 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/38 2024-09-22T03:02:31.614 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/38 2024-09-22T03:02:31.614 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/38 2024-09-22T03:02:31.614 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/38 2024-09-22T03:02:31.614 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/38 2024-09-22T03:02:31.614 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/38 2024-09-22T03:02:31.614 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/38 2024-09-22T03:02:31.614 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 14/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 15/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 16/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 17/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 18/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 19/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 20/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 21/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 22/38 2024-09-22T03:02:31.615 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 23/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 24/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 25/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 26/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 27/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 28/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 29/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 30/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 31/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 32/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 33/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 34/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 35/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 36/38 2024-09-22T03:02:31.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 37/38 2024-09-22T03:02:32.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 38/38 2024-09-22T03:02:32.463 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:32.463 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:02:32.463 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:32.463 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:32.463 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:32.463 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:32.463 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:32.463 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:32.463 INFO:teuthology.orchestra.run.smithi139.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T03:02:32.464 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T03:02:32.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T03:02:32.466 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T03:02:32.466 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T03:02:32.466 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T03:02:32.466 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T03:02:32.466 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:32.466 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:02:32.739 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-base 2024-09-22T03:02:33.321 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:43 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:33.411 INFO:teuthology.orchestra.run.smithi139.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:33.453 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:02:33.455 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-22T03:02:33.455 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:02:33.519 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install cephadm 2024-09-22T03:02:33.600 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 38/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/38 2024-09-22T03:02:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 14/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 15/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 16/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 17/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 18/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 19/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 20/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 21/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 22/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 23/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 24/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 25/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 26/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 27/38 2024-09-22T03:02:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 28/38 2024-09-22T03:02:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 29/38 2024-09-22T03:02:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 30/38 2024-09-22T03:02:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 31/38 2024-09-22T03:02:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 32/38 2024-09-22T03:02:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 33/38 2024-09-22T03:02:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 34/38 2024-09-22T03:02:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 35/38 2024-09-22T03:02:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 36/38 2024-09-22T03:02:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 37/38 2024-09-22T03:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:44 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:34.234 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 765 k 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 771 k 2024-09-22T03:02:34.235 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:02:34.525 INFO:teuthology.orchestra.run.smithi139.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.6 MB/s | 765 kB 00:00 2024-09-22T03:02:34.526 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:34.526 INFO:teuthology.orchestra.run.smithi139.stdout:Total 2.6 MB/s | 765 kB 00:00 2024-09-22T03:02:34.526 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:02:34.531 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:02:34.531 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:02:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 38/38 2024-09-22T03:02:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:34.657 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:02:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T03:02:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T03:02:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T03:02:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T03:02:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T03:02:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T03:02:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:34.660 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:02:34.950 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-base 2024-09-22T03:02:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:35.536 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:45 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:35.626 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:35.668 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:02:35.669 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-22T03:02:35.669 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:02:35.741 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install cephadm 2024-09-22T03:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:02:36.078 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-immutable-object-cache 2024-09-22T03:02:36.321 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:46 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:36.453 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:02:36.454 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:02:36.454 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-22T03:02:36.454 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:02:36.455 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:02:36.455 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-22T03:02:36.455 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:36.455 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:02:36.455 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:02:36.455 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-22T03:02:36.455 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:36.456 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 765 k 2024-09-22T03:02:36.456 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 771 k 2024-09-22T03:02:36.456 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:02:36.671 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:46 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:36.719 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.8 MB/s | 765 kB 00:00 2024-09-22T03:02:36.720 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:36.720 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-22T03:02:36.720 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:02:36.725 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:02:36.725 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:02:36.731 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:02:36.732 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:02:36.805 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:02:36.807 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:02:36.807 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-22T03:02:36.807 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:36.807 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:02:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 147 k 2024-09-22T03:02:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:36.808 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:02:36.808 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:36.808 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-22T03:02:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:36.808 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 147 k 2024-09-22T03:02:36.808 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 481 k 2024-09-22T03:02:36.809 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:02:37.022 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 691 kB/s | 147 kB 00:00 2024-09-22T03:02:37.022 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:37.023 INFO:teuthology.orchestra.run.smithi139.stdout:Total 686 kB/s | 147 kB 00:00 2024-09-22T03:02:37.023 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:02:37.031 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:02:37.031 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:02:37.088 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:02:37.089 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:02:37.250 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:02:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:37.331 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:02:37.347 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:37.357 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:02:37.357 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:37.357 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T03:02:37.357 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:37.992 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:37.992 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:37.992 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:02:37.993 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:37.993 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:37.993 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:02:38.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-immutable-object-cache 2024-09-22T03:02:38.333 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:02:38.333 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:38.333 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:02:38.333 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:38.333 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:38.333 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:02:38.593 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr 2024-09-22T03:02:38.821 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:48 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:38.955 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:02:38.956 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:02:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-22T03:02:38.956 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:02:38.956 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:02:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 147 k 2024-09-22T03:02:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:38.956 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:02:38.956 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:02:38.956 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-22T03:02:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:38.957 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 147 k 2024-09-22T03:02:38.957 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 481 k 2024-09-22T03:02:38.957 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:02:39.174 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 678 kB/s | 147 kB 00:00 2024-09-22T03:02:39.175 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:39.175 INFO:teuthology.orchestra.run.smithi134.stdout:Total 672 kB/s | 147 kB 00:00 2024-09-22T03:02:39.175 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:02:39.182 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:02:39.183 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:02:39.193 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:49 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:39.239 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:02:39.239 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:02:39.283 INFO:teuthology.orchestra.run.smithi139.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:39.325 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:02:39.326 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-22T03:02:39.326 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:02:39.391 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:02:39.407 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-dashboard 2024-09-22T03:02:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:02:39.501 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:02:39.501 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:39.501 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T03:02:39.501 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:39.979 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:49 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:40.110 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:02:40.111 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T03:02:40.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T03:02:40.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T03:02:40.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T03:02:40.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T03:02:40.113 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:40.113 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:02:40.113 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:40.113 INFO:teuthology.orchestra.run.smithi139.stdout:Install 11 Packages 2024-09-22T03:02:40.113 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:40.114 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 7.7 M 2024-09-22T03:02:40.114 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 101 M 2024-09-22T03:02:40.114 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:02:40.474 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:02:40.474 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:40.474 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:02:40.474 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:40.474 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:40.474 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:02:40.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr 2024-09-22T03:02:40.775 INFO:teuthology.orchestra.run.smithi139.stdout:(1/11): ceph-grafana-dashboards-19.1.1-373.g4e4 115 kB/s | 32 kB 00:00 2024-09-22T03:02:40.791 INFO:teuthology.orchestra.run.smithi139.stdout:(2/11): ceph-prometheus-alerts-19.1.1-373.g4e45 56 kB/s | 16 kB 00:00 2024-09-22T03:02:40.942 INFO:teuthology.orchestra.run.smithi139.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 5.6 MB/s | 863 kB 00:00 2024-09-22T03:02:41.017 INFO:teuthology.orchestra.run.smithi139.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 7.1 MB/s | 548 kB 00:00 2024-09-22T03:02:41.042 INFO:teuthology.orchestra.run.smithi139.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-22T03:02:41.160 INFO:teuthology.orchestra.run.smithi139.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 17 MB/s | 2.0 MB 00:00 2024-09-22T03:02:41.184 INFO:teuthology.orchestra.run.smithi139.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-22T03:02:41.210 INFO:teuthology.orchestra.run.smithi139.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-22T03:02:41.243 INFO:teuthology.orchestra.run.smithi139.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-22T03:02:41.302 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:51 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:41.335 INFO:teuthology.orchestra.run.smithi139.stdout:(10/11): ceph-mgr-dashboard-19.1.1-373.g4e45e6b 4.3 MB/s | 3.6 MB 00:00 2024-09-22T03:02:41.393 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:02:41.437 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-22T03:02:41.437 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:02:41.460 INFO:teuthology.orchestra.run.smithi139.stdout:(11/11): python3-protobuf-3.14.0-13.el9.noarch. 393 kB/s | 269 kB 00:00 2024-09-22T03:02:41.464 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:41.464 INFO:teuthology.orchestra.run.smithi139.stdout:Total 5.7 MB/s | 7.7 MB 00:01 2024-09-22T03:02:41.492 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:02:41.509 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:02:41.510 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:02:41.516 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-dashboard 2024-09-22T03:02:41.712 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:02:41.713 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:02:42.125 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:52 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:02:42.264 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:02:42.265 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:02:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-22T03:02:42.265 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:02:42.265 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:02:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-22T03:02:42.265 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-22T03:02:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T03:02:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout:Install 11 Packages 2024-09-22T03:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:42.267 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 7.7 M 2024-09-22T03:02:42.267 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 101 M 2024-09-22T03:02:42.267 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:02:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-22T03:02:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-22T03:02:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-22T03:02:42.581 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-22T03:02:42.636 INFO:teuthology.orchestra.run.smithi134.stdout:(1/11): ceph-grafana-dashboards-19.1.1-373.g4e4 205 kB/s | 32 kB 00:00 2024-09-22T03:02:42.642 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-22T03:02:42.653 INFO:teuthology.orchestra.run.smithi134.stdout:(2/11): ceph-prometheus-alerts-19.1.1-373.g4e45 96 kB/s | 16 kB 00:00 2024-09-22T03:02:42.725 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-22T03:02:42.777 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-22T03:02:42.806 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:02:42.828 INFO:teuthology.orchestra.run.smithi134.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 4.8 MB/s | 863 kB 00:00 2024-09-22T03:02:42.837 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 9/11 2024-09-22T03:02:42.853 INFO:teuthology.orchestra.run.smithi134.stdout:(4/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 269 kB 00:00 2024-09-22T03:02:42.912 INFO:teuthology.orchestra.run.smithi134.stdout:(5/11): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 8.3 MB/s | 3.6 MB 00:00 2024-09-22T03:02:42.962 INFO:teuthology.orchestra.run.smithi134.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 179 kB/s | 19 kB 00:00 2024-09-22T03:02:42.988 INFO:teuthology.orchestra.run.smithi134.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 6.0 MB/s | 144 kB 00:00 2024-09-22T03:02:43.021 INFO:teuthology.orchestra.run.smithi134.stdout:(8/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.8 MB/s | 548 kB 00:00 2024-09-22T03:02:43.047 INFO:teuthology.orchestra.run.smithi134.stdout:(9/11): python3-repoze-lru-0.7-16.el9.noarch.rp 524 kB/s | 31 kB 00:00 2024-09-22T03:02:43.072 INFO:teuthology.orchestra.run.smithi134.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-22T03:02:43.130 INFO:teuthology.orchestra.run.smithi134.stdout:(11/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 10 MB/s | 2.0 MB 00:00 2024-09-22T03:02:43.135 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:43.135 INFO:teuthology.orchestra.run.smithi134.stdout:Total 8.8 MB/s | 7.7 MB 00:00 2024-09-22T03:02:43.164 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:02:43.181 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:02:43.181 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:02:43.395 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:02:43.396 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:02:43.887 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:02:43.893 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 10/11 2024-09-22T03:02:43.930 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 11/11 2024-09-22T03:02:43.970 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-22T03:02:44.009 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-22T03:02:44.116 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-22T03:02:44.250 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-22T03:02:44.295 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-22T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-22T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-22T03:02:44.467 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:02:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 9/11 2024-09-22T03:02:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 11/11 2024-09-22T03:02:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/11 2024-09-22T03:02:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/11 2024-09-22T03:02:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/11 2024-09-22T03:02:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-22T03:02:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-22T03:02:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-22T03:02:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-22T03:02:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:02:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-22T03:02:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-22T03:02:45.565 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 10/11 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T03:02:45.583 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T03:02:45.584 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T03:02:45.584 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:45.584 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 11/11 2024-09-22T03:02:45.829 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-22T03:02:46.411 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:56 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:46.544 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:02:46.546 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-09-22T03:02:46.546 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-22T03:02:46.546 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-09-22T03:02:46.546 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:02:46.546 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-22T03:02:46.546 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-22T03:02:46.546 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T03:02:46.546 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T03:02:46.546 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T03:02:46.546 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout:Install 12 Packages 2024-09-22T03:02:46.547 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:46.548 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 38 M 2024-09-22T03:02:46.548 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 212 M 2024-09-22T03:02:46.548 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:02:46.953 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 11/11 2024-09-22T03:02:46.953 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/11 2024-09-22T03:02:46.953 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/11 2024-09-22T03:02:46.953 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/11 2024-09-22T03:02:46.953 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-22T03:02:46.953 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-22T03:02:46.954 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-22T03:02:46.954 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-22T03:02:46.954 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:02:46.954 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-22T03:02:46.954 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-22T03:02:47.059 INFO:teuthology.orchestra.run.smithi139.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-22T03:02:47.127 INFO:teuthology.orchestra.run.smithi139.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-22T03:02:47.151 INFO:teuthology.orchestra.run.smithi139.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-22T03:02:47.218 INFO:teuthology.orchestra.run.smithi139.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 274 kB/s | 18 kB 00:00 2024-09-22T03:02:47.265 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-22T03:02:47.265 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:47.265 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:02:47.265 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T03:02:47.265 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:47.265 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:47.265 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:47.265 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T03:02:47.265 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T03:02:47.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T03:02:47.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T03:02:47.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T03:02:47.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T03:02:47.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T03:02:47.266 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:47.266 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:02:47.285 INFO:teuthology.orchestra.run.smithi139.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 19 MB/s | 3.0 MB 00:00 2024-09-22T03:02:47.310 INFO:teuthology.orchestra.run.smithi139.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 419 kB/s | 38 kB 00:00 2024-09-22T03:02:47.377 INFO:teuthology.orchestra.run.smithi139.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-22T03:02:47.477 INFO:teuthology.orchestra.run.smithi139.stdout:(8/12): ceph-mgr-diskprediction-local-19.1.1-37 14 MB/s | 7.4 MB 00:00 2024-09-22T03:02:47.535 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-22T03:02:47.561 INFO:teuthology.orchestra.run.smithi139.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 18 MB/s | 4.9 MB 00:00 2024-09-22T03:02:47.653 INFO:teuthology.orchestra.run.smithi139.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-09-22T03:02:47.711 INFO:teuthology.orchestra.run.smithi139.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.0 MB/s | 250 kB 00:00 2024-09-22T03:02:47.887 INFO:teuthology.orchestra.run.smithi139.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 50 MB/s | 16 MB 00:00 2024-09-22T03:02:47.888 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:47.888 INFO:teuthology.orchestra.run.smithi139.stdout:Total 29 MB/s | 38 MB 00:01 2024-09-22T03:02:48.115 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:58 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:48.242 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:02:48.249 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:02:48.250 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-22T03:02:48.250 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-22T03:02:48.250 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-22T03:02:48.250 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:02:48.250 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-22T03:02:48.250 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:48.251 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:02:48.252 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-22T03:02:48.252 INFO:teuthology.orchestra.run.smithi134.stdout:Install 12 Packages 2024-09-22T03:02:48.252 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:02:48.252 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 38 M 2024-09-22T03:02:48.252 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 212 M 2024-09-22T03:02:48.252 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:02:48.269 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:02:48.269 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:02:48.462 INFO:teuthology.orchestra.run.smithi134.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-22T03:02:48.496 INFO:teuthology.orchestra.run.smithi134.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-22T03:02:48.579 INFO:teuthology.orchestra.run.smithi134.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-22T03:02:48.630 INFO:teuthology.orchestra.run.smithi134.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-22T03:02:48.695 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:02:48.695 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:02:48.713 INFO:teuthology.orchestra.run.smithi134.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 462 kB/s | 38 kB 00:00 2024-09-22T03:02:48.805 INFO:teuthology.orchestra.run.smithi134.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-37 15 MB/s | 7.4 MB 00:00 2024-09-22T03:02:48.980 INFO:teuthology.orchestra.run.smithi134.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-22T03:02:49.447 INFO:teuthology.orchestra.run.smithi134.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.1 MB/s | 3.0 MB 00:00 2024-09-22T03:02:49.464 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:02:49.531 INFO:teuthology.orchestra.run.smithi134.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-22T03:02:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-22T03:02:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:02:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:02:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-22T03:02:49.922 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-22T03:02:49.980 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-22T03:02:50.061 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-22T03:02:50.115 INFO:teuthology.orchestra.run.smithi134.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.5 MB/s | 4.9 MB 00:01 2024-09-22T03:02:50.290 INFO:teuthology.orchestra.run.smithi134.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.9 MB/s | 5.1 MB 00:01 2024-09-22T03:02:50.709 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-22T03:02:50.831 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-22T03:02:52.058 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:02:52.131 INFO:teuthology.orchestra.run.smithi134.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.3 MB/s | 16 MB 00:02 2024-09-22T03:02:52.132 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:52.133 INFO:teuthology.orchestra.run.smithi134.stdout:Total 9.9 MB/s | 38 MB 00:03 2024-09-22T03:02:52.482 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:02:52.510 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:02:52.510 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:02:52.941 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:02:52.941 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:02:53.086 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-22T03:02:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-22T03:02:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:02:53.770 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-22T03:02:53.813 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:02:53.912 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:02:53.956 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-22T03:02:54.139 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-22T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-22T03:02:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-22T03:02:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-22T03:02:55.059 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-22T03:02:55.664 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-22T03:02:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-22T03:02:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:02:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:02:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-22T03:02:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-22T03:02:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-22T03:02:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-22T03:02:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-22T03:02:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-22T03:02:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:02:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-22T03:02:56.097 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-22T03:02:56.098 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:56.098 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:02:56.098 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:56.098 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T03:02:56.098 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T03:02:56.098 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T03:02:56.099 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T03:02:56.099 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T03:02:56.099 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T03:02:56.099 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T03:02:56.099 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T03:02:56.099 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T03:02:56.099 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T03:02:56.100 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T03:02:56.100 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:56.100 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:02:56.295 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:02:56.483 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-rook 2024-09-22T03:02:57.078 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:07 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:02:57.211 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:02:57.212 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:57.212 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T03:02:57.213 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T03:02:57.214 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T03:02:57.214 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T03:02:57.214 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:57.214 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:02:57.214 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:02:57.214 INFO:teuthology.orchestra.run.smithi139.stdout:Install 13 Packages 2024-09-22T03:02:57.214 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:02:57.214 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 2.2 M 2024-09-22T03:02:57.215 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 26 M 2024-09-22T03:02:57.215 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:02:57.320 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-22T03:02:57.361 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-22T03:02:57.683 INFO:teuthology.orchestra.run.smithi139.stdout:(1/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 307 kB/s | 49 kB 00:00 2024-09-22T03:02:58.041 INFO:teuthology.orchestra.run.smithi139.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 37 kB/s | 19 kB 00:00 2024-09-22T03:02:58.075 INFO:teuthology.orchestra.run.smithi139.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 46 kB/s | 26 kB 00:00 2024-09-22T03:02:58.533 INFO:teuthology.orchestra.run.smithi139.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 261 kB/s | 222 kB 00:00 2024-09-22T03:02:58.817 INFO:teuthology.orchestra.run.smithi139.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 205 kB/s | 159 kB 00:00 2024-09-22T03:02:58.859 INFO:teuthology.orchestra.run.smithi139.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 780 kB/s | 32 kB 00:00 2024-09-22T03:02:58.884 INFO:teuthology.orchestra.run.smithi139.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 581 kB/s | 14 kB 00:00 2024-09-22T03:02:58.909 INFO:teuthology.orchestra.run.smithi139.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.6 MB/s | 220 kB 00:00 2024-09-22T03:02:58.960 INFO:teuthology.orchestra.run.smithi139.stdout:(9/13): python3-kubernetes-26.1.0-2.el9.noarch. 20 MB/s | 1.0 MB 00:00 2024-09-22T03:02:58.985 INFO:teuthology.orchestra.run.smithi139.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 306 kB/s | 279 kB 00:00 2024-09-22T03:02:59.010 INFO:teuthology.orchestra.run.smithi139.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-22T03:02:59.052 INFO:teuthology.orchestra.run.smithi139.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-09-22T03:02:59.219 INFO:teuthology.orchestra.run.smithi139.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 78 kB/s | 54 kB 00:00 2024-09-22T03:02:59.222 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:59.223 INFO:teuthology.orchestra.run.smithi139.stdout:Total 1.1 MB/s | 2.2 MB 00:02 2024-09-22T03:02:59.294 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:02:59.310 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:02:59.310 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:02:59.400 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:02:59.401 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:02:59.877 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-22T03:02:59.877 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-22T03:02:59.877 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:02:59.877 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:02:59.877 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-22T03:02:59.877 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-22T03:02:59.878 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-22T03:02:59.878 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-22T03:02:59.878 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-22T03:02:59.878 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-22T03:02:59.878 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:02:59.878 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-22T03:02:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:03:00.108 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-22T03:03:00.170 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-22T03:03:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-22T03:03:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-22T03:03:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-22T03:03:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:00.337 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:03:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:03:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T03:03:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T03:03:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T03:03:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T03:03:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T03:03:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T03:03:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T03:03:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T03:03:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T03:03:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T03:03:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T03:03:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:00.338 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-22T03:03:00.440 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-22T03:03:00.551 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-22T03:03:00.606 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-22T03:03:00.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-rook 2024-09-22T03:03:01.330 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-22T03:03:01.353 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:11 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:01.378 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-22T03:03:01.420 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-22T03:03:01.468 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-22T03:03:01.486 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:01.487 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:01.487 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-22T03:03:01.488 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:01.488 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:03:01.488 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-22T03:03:01.488 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-22T03:03:01.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T03:03:01.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T03:03:01.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T03:03:01.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T03:03:01.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T03:03:01.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T03:03:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T03:03:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T03:03:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T03:03:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T03:03:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T03:03:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T03:03:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:01.489 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:03:01.489 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:01.489 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2024-09-22T03:03:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:01.490 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.2 M 2024-09-22T03:03:01.490 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 26 M 2024-09-22T03:03:01.490 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:03:01.490 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-22T03:03:01.776 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 212 kB/s | 49 kB 00:00 2024-09-22T03:03:01.827 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 68 kB/s | 19 kB 00:00 2024-09-22T03:03:01.852 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 83 kB/s | 26 kB 00:00 2024-09-22T03:03:02.194 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 433 kB/s | 159 kB 00:00 2024-09-22T03:03:02.280 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-22T03:03:02.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-22T03:03:02.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-22T03:03:02.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-22T03:03:02.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-22T03:03:02.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-22T03:03:02.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-22T03:03:02.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-22T03:03:02.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-22T03:03:02.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-22T03:03:02.281 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-22T03:03:02.281 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-22T03:03:02.281 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-22T03:03:02.311 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 460 kB/s | 54 kB 00:00 2024-09-22T03:03:02.336 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 397 kB/s | 222 kB 00:00 2024-09-22T03:03:02.361 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 547 kB/s | 279 kB 00:00 2024-09-22T03:03:02.403 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 350 kB/s | 32 kB 00:00 2024-09-22T03:03:02.420 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 169 kB/s | 14 kB 00:00 2024-09-22T03:03:02.445 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-22T03:03:02.470 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.3 MB/s | 220 kB 00:00 2024-09-22T03:03:02.496 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-22T03:03:02.529 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 8.2 MB/s | 1.0 MB 00:00 2024-09-22T03:03:02.532 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:02.532 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.1 MB/s | 2.2 MB 00:01 2024-09-22T03:03:02.598 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:03:02.614 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:03:02.614 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:03:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-22T03:03:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:02.621 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:03:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:03:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T03:03:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T03:03:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T03:03:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T03:03:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T03:03:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T03:03:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T03:03:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T03:03:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T03:03:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T03:03:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T03:03:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T03:03:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:02.623 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:02.704 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:03:02.704 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:03:02.882 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-cephadm 2024-09-22T03:03:03.216 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:03:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-22T03:03:03.467 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:13 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:03.514 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-22T03:03:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-22T03:03:03.600 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:03.601 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:03.601 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-22T03:03:03.601 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:03.601 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:03:03.601 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-22T03:03:03.602 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-22T03:03:03.602 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T03:03:03.602 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T03:03:03.602 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T03:03:03.602 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T03:03:03.602 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T03:03:03.602 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:03.602 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:03:03.602 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:03.602 INFO:teuthology.orchestra.run.smithi139.stdout:Install 6 Packages 2024-09-22T03:03:03.602 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:03.603 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 7.0 M 2024-09-22T03:03:03.603 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 33 M 2024-09-22T03:03:03.603 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:03:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-22T03:03:03.656 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-22T03:03:03.759 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-22T03:03:03.868 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-22T03:03:03.916 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-22T03:03:04.187 INFO:teuthology.orchestra.run.smithi139.stdout:(1/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 308 kB/s | 146 kB 00:00 2024-09-22T03:03:04.237 INFO:teuthology.orchestra.run.smithi139.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-22T03:03:04.263 INFO:teuthology.orchestra.run.smithi139.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-22T03:03:04.288 INFO:teuthology.orchestra.run.smithi139.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-22T03:03:04.538 INFO:teuthology.orchestra.run.smithi139.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 301 kB/s | 248 kB 00:00 2024-09-22T03:03:04.659 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-22T03:03:04.705 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-22T03:03:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-22T03:03:04.786 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-22T03:03:04.816 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-22T03:03:04.889 INFO:teuthology.orchestra.run.smithi139.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-22T03:03:04.893 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:04.893 INFO:teuthology.orchestra.run.smithi139.stdout:Total 5.4 MB/s | 7.0 MB 00:01 2024-09-22T03:03:04.963 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:03:04.974 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:03:04.974 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:03:05.075 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:03:05.076 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:03:05.392 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:03:05.479 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-22T03:03:05.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-22T03:03:05.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-22T03:03:05.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-22T03:03:05.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-22T03:03:05.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-22T03:03:05.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-22T03:03:05.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-22T03:03:05.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-22T03:03:05.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-22T03:03:05.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-22T03:03:05.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-22T03:03:05.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-22T03:03:05.560 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-22T03:03:05.607 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-22T03:03:05.814 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-22T03:03:05.814 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T03:03:05.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T03:03:05.816 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:05.816 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:06.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-cephadm 2024-09-22T03:03:06.128 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-22T03:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-22T03:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-22T03:03:06.327 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-22T03:03:06.668 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:16 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-22T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-22T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-22T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-09-22T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 7.0 M 2024-09-22T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 33 M 2024-09-22T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-22T03:03:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-22T03:03:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-22T03:03:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-22T03:03:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-22T03:03:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-22T03:03:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-22T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-22T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-22T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-22T03:03:07.323 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 316 kB/s | 146 kB 00:00 2024-09-22T03:03:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-22T03:03:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:07.410 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:03:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:03:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T03:03:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T03:03:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T03:03:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T03:03:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T03:03:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:07.411 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:07.694 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-fuse 2024-09-22T03:03:08.278 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:18 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:08.413 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:08.414 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:08.414 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-22T03:03:08.414 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:08.414 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:03:08.414 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 868 k 2024-09-22T03:03:08.414 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-22T03:03:08.414 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T03:03:08.414 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:08.414 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:03:08.414 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:08.414 INFO:teuthology.orchestra.run.smithi139.stdout:Install 2 Packages 2024-09-22T03:03:08.415 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:08.415 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 948 k 2024-09-22T03:03:08.415 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 3.1 M 2024-09-22T03:03:08.415 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:03:08.848 INFO:teuthology.orchestra.run.smithi139.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 519 kB/s | 80 kB 00:00 2024-09-22T03:03:09.340 INFO:teuthology.orchestra.run.smithi139.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 1.3 MB/s | 868 kB 00:00 2024-09-22T03:03:09.341 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:09.341 INFO:teuthology.orchestra.run.smithi139.stdout:Total 1.0 MB/s | 948 kB 00:00 2024-09-22T03:03:09.354 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:03:09.356 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-22T03:03:09.358 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:09.359 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.7 MB/s | 7.0 MB 00:02 2024-09-22T03:03:09.378 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:03:09.378 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:03:09.429 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:03:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:03:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:03:09.459 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:03:09.459 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:03:09.542 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:03:09.542 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:03:09.643 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:03:09.784 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-22T03:03:09.848 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-22T03:03:09.868 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:03:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-22T03:03:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-22T03:03:10.532 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-22T03:03:10.532 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-22T03:03:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-22T03:03:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-22T03:03:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-22T03:03:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-22T03:03:10.847 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-22T03:03:10.847 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:10.847 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:03:10.847 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-22T03:03:10.847 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:10.847 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:11.192 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-volume 2024-09-22T03:03:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-22T03:03:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-22T03:03:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-22T03:03:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-22T03:03:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-22T03:03:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-22T03:03:11.795 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:21 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:11.904 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-22T03:03:11.905 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:11.905 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:03:11.905 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:03:11.905 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T03:03:11.905 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T03:03:11.905 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T03:03:11.905 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T03:03:11.905 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T03:03:11.905 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:11.905 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:11.932 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:11.932 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:11.932 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-22T03:03:11.933 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:11.933 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:03:11.933 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 285 k 2024-09-22T03:03:11.933 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:11.933 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:03:11.933 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:11.933 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-22T03:03:11.933 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:11.933 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 285 k 2024-09-22T03:03:11.933 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 1.3 M 2024-09-22T03:03:11.933 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:03:12.177 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-volume-19.1.1-373.g4e45e6b4.el9.noarch.rpm 1.1 MB/s | 285 kB 00:00 2024-09-22T03:03:12.177 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:12.178 INFO:teuthology.orchestra.run.smithi139.stdout:Total 1.1 MB/s | 285 kB 00:00 2024-09-22T03:03:12.178 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:03:12.182 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-fuse 2024-09-22T03:03:12.186 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:03:12.187 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:03:12.214 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:03:12.214 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:03:12.434 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:03:12.496 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:03:12.512 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:03:12.513 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:03:12.513 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T03:03:12.513 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:12.763 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:22 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:12.899 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:12.899 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-22T03:03:12.899 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:12.899 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:03:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 868 k 2024-09-22T03:03:12.899 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-22T03:03:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T03:03:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:12.900 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:03:12.900 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:12.900 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2024-09-22T03:03:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:12.901 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 948 k 2024-09-22T03:03:12.901 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 3.1 M 2024-09-22T03:03:12.901 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:03:13.175 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 512 kB/s | 80 kB 00:00 2024-09-22T03:03:13.333 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 2.7 MB/s | 868 kB 00:00 2024-09-22T03:03:13.334 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:13.334 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.1 MB/s | 948 kB 00:00 2024-09-22T03:03:13.345 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:03:13.366 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:03:13.367 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:03:13.446 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:03:13.446 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:03:13.525 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:03:13.525 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:13.526 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:03:13.526 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:03:13.526 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:13.526 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:13.641 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:03:13.777 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-22T03:03:13.841 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librados-devel 2024-09-22T03:03:13.857 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-22T03:03:14.440 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:24 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:14.564 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-22T03:03:14.564 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-22T03:03:14.573 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:14.573 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:14.573 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-22T03:03:14.573 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:14.573 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:03:14.573 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-22T03:03:14.573 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:14.574 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:03:14.574 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:14.574 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-22T03:03:14.574 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:14.574 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 127 k 2024-09-22T03:03:14.574 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 457 k 2024-09-22T03:03:14.574 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:03:14.782 INFO:teuthology.orchestra.run.smithi139.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 611 kB/s | 127 kB 00:00 2024-09-22T03:03:14.782 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:14.783 INFO:teuthology.orchestra.run.smithi139.stdout:Total 607 kB/s | 127 kB 00:00 2024-09-22T03:03:14.783 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:03:14.788 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:03:14.788 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:03:14.852 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-22T03:03:14.852 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:03:14.853 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-22T03:03:14.853 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:14.853 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:03:14.853 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:03:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:03:15.113 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:15.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-volume 2024-09-22T03:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:15.759 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:25 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:15.809 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:15.809 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:15.809 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:03:15.809 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:03:15.809 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:15.809 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-22T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 285 k 2024-09-22T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-22T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 285 k 2024-09-22T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 1.3 M 2024-09-22T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:03:16.041 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install libcephfs2 2024-09-22T03:03:16.220 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-volume-19.1.1-373.g4e45e6b4.el9.noarch.rpm 881 kB/s | 285 kB 00:00 2024-09-22T03:03:16.221 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:16.221 INFO:teuthology.orchestra.run.smithi134.stdout:Total 876 kB/s | 285 kB 00:00 2024-09-22T03:03:16.221 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:03:16.230 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:03:16.230 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:03:16.263 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:03:16.264 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:03:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:03:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:03:16.564 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:03:16.564 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:03:16.564 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T03:03:16.564 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:26 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:16.716 INFO:teuthology.orchestra.run.smithi139.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:16.839 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install libcephfs-devel 2024-09-22T03:03:17.422 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:27 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:17.539 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:03:17.539 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:17.539 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:03:17.539 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:03:17.539 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:17.539 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:17.554 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 32 k 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 142 k 2024-09-22T03:03:17.555 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:03:17.710 INFO:teuthology.orchestra.run.smithi139.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 205 kB/s | 32 kB 00:00 2024-09-22T03:03:17.711 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:17.711 INFO:teuthology.orchestra.run.smithi139.stdout:Total 204 kB/s | 32 kB 00:00 2024-09-22T03:03:17.711 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:03:17.714 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:03:17.715 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:03:17.736 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:03:17.736 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:03:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:03:17.842 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados-devel 2024-09-22T03:03:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:18.278 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:18.442 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:28 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:18.523 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:18.523 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:18.523 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:03:18.523 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:03:18.523 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:18.523 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:18.576 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:18.577 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:18.577 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-22T03:03:18.577 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:18.577 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:03:18.577 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-22T03:03:18.577 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:18.577 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:03:18.577 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:18.577 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-22T03:03:18.577 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:18.578 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 127 k 2024-09-22T03:03:18.578 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 457 k 2024-09-22T03:03:18.578 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:03:18.714 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librados2 2024-09-22T03:03:18.758 INFO:teuthology.orchestra.run.smithi134.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 705 kB/s | 127 kB 00:00 2024-09-22T03:03:18.759 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:18.759 INFO:teuthology.orchestra.run.smithi134.stdout:Total 699 kB/s | 127 kB 00:00 2024-09-22T03:03:18.759 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:03:18.765 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:03:18.765 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:03:18.830 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:03:18.830 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:03:18.985 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:03:19.106 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:29 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:19.381 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:19.425 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:19.426 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-22T03:03:19.426 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:19.495 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librbd1 2024-09-22T03:03:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:19.800 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:03:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:03:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:19.801 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:20.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs2 2024-09-22T03:03:20.075 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:30 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:20.167 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:20.211 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:20.212 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-22T03:03:20.212 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:20.279 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rados 2024-09-22T03:03:20.657 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:30 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-22T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:20.856 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:30 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:20.867 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs-devel 2024-09-22T03:03:20.945 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:20.989 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:20.990 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-22T03:03:20.990 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:21.070 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rgw 2024-09-22T03:03:21.453 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:31 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:21.584 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:21.585 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:21.585 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-22T03:03:21.585 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:21.585 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:03:21.585 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-22T03:03:21.585 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:21.585 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:03:21.585 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:21.585 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-22T03:03:21.585 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:21.586 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 32 k 2024-09-22T03:03:21.586 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 142 k 2024-09-22T03:03:21.586 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:03:21.644 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:31 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:21.734 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:21.744 INFO:teuthology.orchestra.run.smithi134.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 201 kB/s | 32 kB 00:00 2024-09-22T03:03:21.745 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:21.745 INFO:teuthology.orchestra.run.smithi134.stdout:Total 199 kB/s | 32 kB 00:00 2024-09-22T03:03:21.745 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:03:21.749 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:03:21.749 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:03:21.767 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:03:21.768 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:03:21.779 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:21.780 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-22T03:03:21.781 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:21.855 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-cephfs 2024-09-22T03:03:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:03:21.975 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:22.373 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:22.428 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:32 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:22.517 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:22.560 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:22.561 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-22T03:03:22.561 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:22.624 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:22.625 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:22.625 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:03:22.625 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:03:22.625 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:22.625 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:22.632 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rbd 2024-09-22T03:03:22.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados2 2024-09-22T03:03:23.208 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:33 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:23.298 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:23.342 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:23.344 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-22T03:03:23.344 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:23.392 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:33 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:23.415 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-fuse 2024-09-22T03:03:23.485 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:23.528 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:23.529 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-22T03:03:23.529 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:23.603 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librbd1 2024-09-22T03:03:24.006 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:34 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:24.148 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:24.149 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:24.149 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-09-22T03:03:24.149 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:24.149 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:03:24.149 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-22T03:03:24.149 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:24.149 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:03:24.149 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:24.149 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-22T03:03:24.149 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:24.150 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 85 k 2024-09-22T03:03:24.150 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 256 k 2024-09-22T03:03:24.150 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:03:24.184 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:34 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:24.275 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:24.319 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:24.320 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-22T03:03:24.320 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:24.347 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 436 kB/s | 85 kB 00:00 2024-09-22T03:03:24.347 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:24.348 INFO:teuthology.orchestra.run.smithi139.stdout:Total 431 kB/s | 85 kB 00:00 2024-09-22T03:03:24.348 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:03:24.355 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:03:24.355 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:03:24.393 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rados 2024-09-22T03:03:24.420 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:03:24.420 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:03:24.570 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:24.972 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:34 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:25.061 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:25.104 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:25.105 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-22T03:03:25.106 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:25.107 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:25.173 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rgw 2024-09-22T03:03:25.348 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:25.349 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:25.349 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:03:25.349 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:03:25.349 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:25.349 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:25.650 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-mirror 2024-09-22T03:03:25.751 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:35 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-22T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:25.961 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-cephfs 2024-09-22T03:03:26.240 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:36 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:26.376 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:26.376 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:26.376 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-22T03:03:26.377 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:26.377 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:03:26.377 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-22T03:03:26.377 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:26.377 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:03:26.377 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:26.377 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-22T03:03:26.377 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:26.378 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 3.1 M 2024-09-22T03:03:26.378 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 14 M 2024-09-22T03:03:26.378 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:03:26.538 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:36 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:26.628 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:26.671 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:26.672 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-22T03:03:26.673 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:26.717 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.0 MB/s | 3.1 MB 00:00 2024-09-22T03:03:26.717 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:26.718 INFO:teuthology.orchestra.run.smithi139.stdout:Total 9.0 MB/s | 3.1 MB 00:00 2024-09-22T03:03:26.718 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:03:26.727 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:03:26.727 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:03:26.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rbd 2024-09-22T03:03:26.808 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:03:26.808 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:03:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:03:27.321 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:37 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:27.326 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:27.351 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:27.351 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:03:27.351 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T03:03:27.352 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:03:27.352 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:03:27.352 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:27.411 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:03:27.454 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:27.455 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-22T03:03:27.455 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:27.540 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-fuse 2024-09-22T03:03:28.124 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:38 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:28.258 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:28.259 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:28.259 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-22T03:03:28.259 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:28.259 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:03:28.259 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-22T03:03:28.259 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:28.260 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:03:28.260 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:28.260 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-22T03:03:28.260 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:28.260 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 85 k 2024-09-22T03:03:28.260 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 256 k 2024-09-22T03:03:28.260 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:03:28.439 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:28.439 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:28.440 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:03:28.440 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:03:28.440 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:28.440 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:28.456 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 437 kB/s | 85 kB 00:00 2024-09-22T03:03:28.456 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:28.457 INFO:teuthology.orchestra.run.smithi134.stdout:Total 434 kB/s | 85 kB 00:00 2024-09-22T03:03:28.457 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:03:28.463 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:03:28.463 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:03:28.527 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:03:28.527 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:03:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:03:28.714 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-nbd 2024-09-22T03:03:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:29.187 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:29.322 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:39 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:29.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:29.397 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:29.397 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:03:29.398 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:03:29.398 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:29.398 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:29.459 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-22T03:03:29.460 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:29.460 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-09-22T03:03:29.460 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:29.460 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-22T03:03:29.460 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 169 k 2024-09-22T03:03:29.460 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:29.460 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-22T03:03:29.460 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-22T03:03:29.460 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-22T03:03:29.460 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:29.460 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 169 k 2024-09-22T03:03:29.461 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 540 k 2024-09-22T03:03:29.461 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-22T03:03:29.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-mirror 2024-09-22T03:03:29.670 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 811 kB/s | 169 kB 00:00 2024-09-22T03:03:29.670 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:29.671 INFO:teuthology.orchestra.run.smithi139.stdout:Total 804 kB/s | 169 kB 00:00 2024-09-22T03:03:29.671 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-22T03:03:29.678 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-22T03:03:29.679 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-22T03:03:29.743 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-22T03:03:29.744 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-22T03:03:29.903 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-22T03:03:30.011 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:30.256 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:40 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:30.396 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:30.396 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 3.1 M 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 14 M 2024-09-22T03:03:30.397 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:03:30.442 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:30.716 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-22T03:03:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:03:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:30.716 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-22T03:03:30.741 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 8.9 MB/s | 3.1 MB 00:00 2024-09-22T03:03:30.742 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:30.742 INFO:teuthology.orchestra.run.smithi134.stdout:Total 8.8 MB/s | 3.1 MB 00:00 2024-09-22T03:03:30.743 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:03:30.751 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:03:30.752 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:03:30.833 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:03:30.833 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:03:31.017 DEBUG:teuthology.parallel:result is None 2024-09-22T03:03:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:03:31.342 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:31.366 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:31.366 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:03:31.366 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T03:03:31.366 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:03:31.366 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:03:31.366 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:32.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:32.468 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:32.468 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:03:32.468 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:03:32.468 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:32.468 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:32.727 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-nbd 2024-09-22T03:03:33.324 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:43 ago on Sun 22 Sep 2024 03:00:50 AM UTC. 2024-09-22T03:03:33.462 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-22T03:03:33.463 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-22T03:03:33.463 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:33.463 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-22T03:03:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 169 k 2024-09-22T03:03:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:33.463 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-22T03:03:33.463 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-22T03:03:33.464 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-22T03:03:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:33.464 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 169 k 2024-09-22T03:03:33.464 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 540 k 2024-09-22T03:03:33.464 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-22T03:03:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 796 kB/s | 169 kB 00:00 2024-09-22T03:03:33.678 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:03:33.678 INFO:teuthology.orchestra.run.smithi134.stdout:Total 790 kB/s | 169 kB 00:00 2024-09-22T03:03:33.678 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-22T03:03:33.686 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-22T03:03:33.686 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-22T03:03:33.750 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-22T03:03:33.750 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-22T03:03:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-22T03:03:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:34.500 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:03:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:34.740 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-22T03:03:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:03:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:34.740 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-22T03:03:34.988 DEBUG:teuthology.parallel:result is None 2024-09-22T03:03:34.989 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T03:03:35.125 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T03:03:35.146 INFO:teuthology.orchestra.run.smithi134.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-22T03:03:35.147 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-22T03:03:35.147 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-22T03:03:35.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T03:03:35.283 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T03:03:35.307 INFO:teuthology.orchestra.run.smithi139.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-22T03:03:35.307 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-22T03:03:35.307 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-22T03:03:35.309 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-22T03:03:35.309 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:03:35.309 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T03:03:35.335 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:03:35.335 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T03:03:35.375 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-22T03:03:35.375 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:03:35.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T03:03:35.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T03:03:35.465 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:03:35.465 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T03:03:35.491 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T03:03:35.557 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-22T03:03:35.558 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:03:35.558 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T03:03:35.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T03:03:35.646 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:03:35.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T03:03:35.672 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T03:03:35.737 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-22T03:03:35.738 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:03:35.738 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T03:03:35.762 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T03:03:35.826 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:03:35.826 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T03:03:35.851 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T03:03:35.916 INFO:teuthology.run_tasks:Running task ceph... 2024-09-22T03:03:35.988 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-22T03:03:35.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-09-22T03:03:35.991 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2024-09-22T03:03:36.015 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-22T03:03:36.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T03:03:36.056 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T03:03:36.080 INFO:tasks.ceph:Creating extra log directories... 2024-09-22T03:03:36.080 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T03:03:36.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T03:03:36.154 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-22T03:03:36.154 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-22T03:03:36.154 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914719', 'branch': 'squid', 'description': 'crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7914719', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'squid', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1158, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'crimson-rados', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'targets': {'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1zuj/H5uEUU7dKfzFP/od5dqPfKlATKU8HMHSjV6+zOckM3hcVZ0EQMoL2I2ciK8t9t47TlyIboXkU3wGjTYk=', 'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWT3lOd42nCZxI2mAaw5hiVouBDsT43zsW12biLhYfHjAIRNvQ42k7CKfVBcII1pnZYAZMVVvjcx+pbW7V/2KA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-21_21:56:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-22T03:03:36.155 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T03:03:36.186 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T03:03:36.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T03:03:36.241 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T03:03:36.266 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:03:36.266 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T03:03:36.319 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T03:03:36.319 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-22T03:03:36.374 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T03:03:36.374 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:03:36.374 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-22T03:03:36.375 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:03:36.375 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:03:36.375 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-22 03:03:31.624011281 +0000 2024-09-22T03:03:36.375 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-22 03:00:11.605916604 +0000 2024-09-22T03:03:36.375 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-22 03:00:11.605916604 +0000 2024-09-22T03:03:36.375 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-22 03:00:11.605916604 +0000 2024-09-22T03:03:36.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T03:03:36.437 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-22T03:03:36.437 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-22T03:03:36.438 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00018312 s, 2.8 MB/s 2024-09-22T03:03:36.439 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T03:03:36.494 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-22T03:03:36.549 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T03:03:36.550 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:03:36.550 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-22T03:03:36.550 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:03:36.550 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:03:36.550 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-22 03:03:31.625011257 +0000 2024-09-22T03:03:36.550 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-22 03:00:11.940908339 +0000 2024-09-22T03:03:36.550 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-22 03:00:11.940908339 +0000 2024-09-22T03:03:36.550 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-22 03:00:11.940908339 +0000 2024-09-22T03:03:36.550 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T03:03:36.612 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-22T03:03:36.613 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-22T03:03:36.613 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000214198 s, 2.4 MB/s 2024-09-22T03:03:36.614 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T03:03:36.670 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-22T03:03:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T03:03:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:03:36.726 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-22T03:03:36.726 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:03:36.726 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:03:36.726 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-22 03:03:31.625011257 +0000 2024-09-22T03:03:36.726 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-22 03:00:12.249900716 +0000 2024-09-22T03:03:36.726 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-22 03:00:12.249900716 +0000 2024-09-22T03:03:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-22 03:00:12.249900716 +0000 2024-09-22T03:03:36.726 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T03:03:36.788 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-22T03:03:36.788 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-22T03:03:36.788 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000213255 s, 2.4 MB/s 2024-09-22T03:03:36.789 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T03:03:36.845 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-22T03:03:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T03:03:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:03:36.900 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-22T03:03:36.900 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:03:36.900 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:03:36.900 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-22 03:03:31.626011233 +0000 2024-09-22T03:03:36.901 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-22 03:00:12.562892995 +0000 2024-09-22T03:03:36.901 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-22 03:00:12.562892995 +0000 2024-09-22T03:03:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-22 03:00:12.562892995 +0000 2024-09-22T03:03:36.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T03:03:36.963 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-22T03:03:36.963 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-22T03:03:36.963 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000164894 s, 3.1 MB/s 2024-09-22T03:03:36.964 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T03:03:37.020 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-22T03:03:37.020 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:03:37.020 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T03:03:37.038 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T03:03:37.038 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-09-22T03:03:37.094 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T03:03:37.094 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:03:37.094 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-22T03:03:37.095 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:03:37.095 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:03:37.095 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-22 03:03:27.599908340 +0000 2024-09-22T03:03:37.095 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-22 03:00:11.616204823 +0000 2024-09-22T03:03:37.095 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-22 03:00:11.616204823 +0000 2024-09-22T03:03:37.095 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-22 03:00:11.616204823 +0000 2024-09-22T03:03:37.095 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T03:03:37.160 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-22T03:03:37.160 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-22T03:03:37.160 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000215684 s, 2.4 MB/s 2024-09-22T03:03:37.161 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T03:03:37.220 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-09-22T03:03:37.276 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T03:03:37.277 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:03:37.277 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-22T03:03:37.277 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:03:37.277 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:03:37.277 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-22 03:03:27.599908340 +0000 2024-09-22T03:03:37.277 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-22 03:00:11.951197644 +0000 2024-09-22T03:03:37.277 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-22 03:00:11.951197644 +0000 2024-09-22T03:03:37.277 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-22 03:00:11.951197644 +0000 2024-09-22T03:03:37.277 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T03:03:37.340 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-22T03:03:37.341 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-22T03:03:37.341 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000244765 s, 2.1 MB/s 2024-09-22T03:03:37.342 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T03:03:37.399 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-09-22T03:03:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T03:03:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:03:37.456 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-22T03:03:37.456 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:03:37.456 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:03:37.456 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-22 03:03:27.600908319 +0000 2024-09-22T03:03:37.456 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-22 03:00:12.282190551 +0000 2024-09-22T03:03:37.456 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-22 03:00:12.282190551 +0000 2024-09-22T03:03:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-22 03:00:12.282190551 +0000 2024-09-22T03:03:37.456 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T03:03:37.519 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-22T03:03:37.519 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-22T03:03:37.519 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000223994 s, 2.3 MB/s 2024-09-22T03:03:37.521 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T03:03:37.578 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-09-22T03:03:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T03:03:37.633 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:03:37.633 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-22T03:03:37.633 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:03:37.633 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:03:37.633 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-22 03:03:27.600908319 +0000 2024-09-22T03:03:37.633 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-22 03:00:12.615183415 +0000 2024-09-22T03:03:37.633 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-22 03:00:12.615183415 +0000 2024-09-22T03:03:37.633 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-22 03:00:12.615183415 +0000 2024-09-22T03:03:37.633 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T03:03:37.696 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-22T03:03:37.696 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-22T03:03:37.696 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000211099 s, 2.4 MB/s 2024-09-22T03:03:37.697 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T03:03:37.753 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-22T03:03:37.753 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-22T03:03:37.754 INFO:tasks.ceph:Generating config... 2024-09-22T03:03:37.755 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-22T03:03:37.755 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-22T03:03:37.755 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-22T03:03:37.755 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-22T03:03:37.755 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-22T03:03:37.755 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-22T03:03:37.755 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-22T03:03:37.755 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-22T03:03:37.755 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] log to file = False 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-09-22T03:03:37.756 INFO:tasks.ceph:[osd] osd delete sleep = 1 2024-09-22T03:03:37.757 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-22T03:03:37.757 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-22T03:03:37.757 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-22T03:03:37.757 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-22T03:03:37.757 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-22T03:03:37.757 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-22T03:03:37.757 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-22T03:03:37.757 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2024-09-22T03:03:37.757 INFO:tasks.ceph:[client.0] debug ms = 1 2024-09-22T03:03:37.757 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-22T03:03:37.757 INFO:tasks.ceph:[client.0] debug rados = 20 2024-09-22T03:03:37.757 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-22T03:03:37.757 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-22T03:03:37.757 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-22T03:03:37.758 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-22T03:03:37.758 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-22T03:03:37.758 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-22T03:03:37.758 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-22T03:03:37.758 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2024-09-22T03:03:37.758 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2024-09-22T03:03:37.758 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-22T03:03:37.758 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-22T03:03:37.758 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-22T03:03:37.758 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-22T03:03:37.758 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-22T03:03:37.758 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-22T03:03:37.759 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-22T03:03:37.759 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-22T03:03:37.759 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-22T03:03:37.759 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-22T03:03:37.759 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-22T03:03:37.759 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-22T03:03:37.759 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-22T03:03:37.759 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-22T03:03:37.759 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-22T03:03:37.759 INFO:tasks.ceph:Setting up mon.a... 2024-09-22T03:03:37.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-22T03:03:37.812 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.keyring 2024-09-22T03:03:37.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-22T03:03:37.863 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T03:03:37.887 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.134')] 2024-09-22T03:03:37.888 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.134', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-22T03:03:37.889 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:03:37.889 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T03:03:37.943 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.134 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:03:38.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:03:38.028+0000 7f0825844e80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:38.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:03:38.028+0000 7f0825844e80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:38.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:03:38.028+0000 7f0825844e80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:38.031 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:03:38.031 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: generated fsid 3c083707-cce1-453e-8e70-29f18e875f9d 2024-09-22T03:03:38.031 INFO:teuthology.orchestra.run.smithi134.stdout:setting min_mon_release = quincy 2024-09-22T03:03:38.031 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 0 2024-09-22T03:03:38.031 INFO:teuthology.orchestra.run.smithi134.stdout:fsid 3c083707-cce1-453e-8e70-29f18e875f9d 2024-09-22T03:03:38.031 INFO:teuthology.orchestra.run.smithi134.stdout:last_changed 2024-09-22T03:03:38.029794+0000 2024-09-22T03:03:38.031 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-09-22T03:03:38.029794+0000 2024-09-22T03:03:38.031 INFO:teuthology.orchestra.run.smithi134.stdout:min_mon_release 17 (quincy) 2024-09-22T03:03:38.031 INFO:teuthology.orchestra.run.smithi134.stdout:election_strategy: 1 2024-09-22T03:03:38.032 INFO:teuthology.orchestra.run.smithi134.stdout:0: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.a 2024-09-22T03:03:38.032 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-22T03:03:38.033 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T03:03:38.047 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3c083707-cce1-453e-8e70-29f18e875f9d... 2024-09-22T03:03:38.048 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T03:03:38.090 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T03:03:38.130 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-09-22T03:03:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-09-22T03:03:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-09-22T03:03:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = 172.21.15.134 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: ms client mode = crc 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: ms cluster mode = crc 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: ms mon client mode = crc 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: ms mon cluster mode = crc 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: ms mon service mode = crc 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: ms service mode = crc 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_min_size = 2 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_size = 3 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 3c083707-cce1-453e-8e70-29f18e875f9d 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-09-22T03:03:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 120 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-09-22T03:03:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: debug monc = 20 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression algorithm = snappy 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression mode = aggressive 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore rocksdb cf = False 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: crimson alien thread cpu cores = 6-7 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: crimson osd obc lru size = 10 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2024-09-22T03:03:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: err to stderr = True 2024-09-22T03:03:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: log flush on exit = True 2024-09-22T03:03:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: log to file = False 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: log to stderr = True 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: osd blocked scrub grace period = 3600 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug reject backfill probability = 0.3 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: osd delete sleep = 1 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: osd max backfills = 3 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: osd max markdown count = 1000 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub min interval = 60 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: osd shutdown pgref assert = True 2024-09-22T03:03:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: osd snap trim sleep = 2 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-22T03:03:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: mon min osdmap epochs = 50 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: mon osdmap full prune interval = 2 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: mon osdmap full prune min = 15 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: mon osdmap full prune txsize = 2 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default crimson = True 2024-09-22T03:03:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: paxos service trim min = 10 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: debug objecter = 20 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: debug rados = 20 2024-09-22T03:03:38.143 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-09-22T03:03:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:03:38.144 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-09-22T03:03:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:03:38.144 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-09-22T03:03:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:03:38.144 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-09-22T03:03:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:03:38.145 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2024-09-22T03:03:38.145 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2024-09-22T03:03:38.145 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.146 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2024-09-22T03:03:38.147 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = 172.21.15.134 2024-09-22T03:03:38.148 INFO:teuthology.orchestra.run.smithi139.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: ms client mode = crc 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: ms cluster mode = crc 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: ms mon client mode = crc 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: ms mon cluster mode = crc 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: ms mon service mode = crc 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: ms service mode = crc 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_min_size = 2 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_size = 3 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = 3c083707-cce1-453e-8e70-29f18e875f9d 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2024-09-22T03:03:38.149 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 120 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug trim objects = true 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2024-09-22T03:03:38.150 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2024-09-22T03:03:38.151 INFO:teuthology.orchestra.run.smithi139.stdout: debug monc = 20 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore compression algorithm = snappy 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore compression mode = aggressive 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore rocksdb cf = False 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: crimson alien thread cpu cores = 6-7 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: crimson osd obc lru size = 10 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 20 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 20 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 10 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: err to stderr = True 2024-09-22T03:03:38.152 INFO:teuthology.orchestra.run.smithi139.stdout: log flush on exit = True 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: log to file = False 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: log to stderr = True 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: osd blocked scrub grace period = 3600 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug reject backfill probability = 0.3 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: osd delete sleep = 1 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: osd max backfills = 3 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: osd max markdown count = 1000 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub min interval = 60 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: osd shutdown pgref assert = True 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: osd snap trim sleep = 2 2024-09-22T03:03:38.153 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2024-09-22T03:03:38.154 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T03:03:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: mon min osdmap epochs = 50 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: mon osdmap full prune interval = 2 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: mon osdmap full prune min = 15 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: mon osdmap full prune txsize = 2 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default crimson = True 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: paxos service trim min = 10 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2024-09-22T03:03:38.156 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout: debug objecter = 20 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout: debug rados = 20 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.3] 2024-09-22T03:03:38.157 INFO:teuthology.orchestra.run.smithi139.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:03:38.158 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-22T03:03:38.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-22T03:03:38.245 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-22T03:03:38.246 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:03:38.246 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-22T03:03:38.261 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:03:38.261 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-22T03:03:38.315 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-09-22T03:03:38.316 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:03:38.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T03:03:38.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T03:03:38.390 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:03:38.390 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:03:38.444 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2024-09-22T03:03:38.444 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:03:38.444 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T03:03:38.444 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T03:03:38.479 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:03:38.479 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:03:38.534 INFO:tasks.ceph:Setting up mon nodes... 2024-09-22T03:03:38.535 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-22T03:03:38.535 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T03:03:38.640 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T03:03:38.643 INFO:tasks.ceph:Setting up mds nodes... 2024-09-22T03:03:38.644 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-22T03:03:38.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-22T03:03:38.691 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-22T03:03:38.704 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-22T03:03:38.751 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-22T03:03:38.764 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-22T03:03:38.765 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-22T03:03:38.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-22T03:03:38.790 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-22T03:03:38.790 INFO:tasks.ceph:role: osd.0 2024-09-22T03:03:38.790 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-22T03:03:38.790 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T03:03:38.863 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:03:38.863 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:03:38.863 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:03:38.863 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:03:38.863 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:03:38.863 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:03:38.864 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:03:38.864 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:03:38.864 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:03:38.864 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:03:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-22T03:03:39.357 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-22T03:03:39.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-22T03:03:39.499 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-22T03:03:39.531 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-22T03:03:39.597 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-22T03:03:39.597 INFO:tasks.ceph:role: osd.1 2024-09-22T03:03:39.597 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-22T03:03:39.598 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T03:03:39.671 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:03:39.671 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:03:39.672 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:03:39.672 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:03:39.672 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:03:39.672 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:03:39.672 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:03:39.672 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:03:39.672 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:03:39.672 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:03:40.114 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-22T03:03:40.116 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-22T03:03:40.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-22T03:03:40.198 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-22T03:03:40.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:03:40.865 INFO:teuthology.orchestra.run.smithi134.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:03:40.866 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-22 03:03:40,865 seastar - Reactor backend: linux-aio 2024-09-22T03:03:40.888 INFO:teuthology.orchestra.run.smithi134.stderr:==27515==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:03:40.937 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-22 03:03:40,936 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:03:40.937 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-22 03:03:40,936 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-22T03:03:40.937 INFO:teuthology.orchestra.run.smithi134.stderr:DEBUG 2024-09-22 03:03:40,937 [shard 0:main] seastar - reactor::drain 2024-09-22T03:03:41.441 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-22T03:03:41.442 INFO:teuthology.orchestra.run.smithi134.stderr:Suppressions used: 2024-09-22T03:03:41.442 INFO:teuthology.orchestra.run.smithi134.stderr: count bytes template 2024-09-22T03:03:41.442 INFO:teuthology.orchestra.run.smithi134.stderr: 1 8 MallocExtension::Register 2024-09-22T03:03:41.442 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-22T03:03:41.442 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:03:41.493 INFO:teuthology.orchestra.run.smithi134.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:03:41.495 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-22 03:03:41,494 seastar - Reactor backend: linux-aio 2024-09-22T03:03:41.531 INFO:teuthology.orchestra.run.smithi134.stderr:==27511==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:03:46.633 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-22T03:03:46.633 INFO:teuthology.orchestra.run.smithi134.stderr:Suppressions used: 2024-09-22T03:03:46.633 INFO:teuthology.orchestra.run.smithi134.stderr: count bytes template 2024-09-22T03:03:46.633 INFO:teuthology.orchestra.run.smithi134.stderr: 1 8 MallocExtension::Register 2024-09-22T03:03:46.633 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-22T03:03:46.633 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:03:46.633 INFO:teuthology.orchestra.run.smithi134.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 3c083707-cce1-453e-8e70-29f18e875f9d 2024-09-22T03:03:46.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-22T03:03:46.697 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:03:47.243 INFO:teuthology.orchestra.run.smithi134.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:03:47.244 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-22 03:03:47,244 seastar - Reactor backend: linux-aio 2024-09-22T03:03:47.266 INFO:teuthology.orchestra.run.smithi134.stderr:==27702==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:03:47.311 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-22 03:03:47,310 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:03:47.311 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-22 03:03:47,310 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-22T03:03:47.312 INFO:teuthology.orchestra.run.smithi134.stderr:DEBUG 2024-09-22 03:03:47,311 [shard 0:main] seastar - reactor::drain 2024-09-22T03:03:47.788 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-22T03:03:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:Suppressions used: 2024-09-22T03:03:47.789 INFO:teuthology.orchestra.run.smithi134.stderr: count bytes template 2024-09-22T03:03:47.789 INFO:teuthology.orchestra.run.smithi134.stderr: 1 8 MallocExtension::Register 2024-09-22T03:03:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-22T03:03:47.789 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:03:47.850 INFO:teuthology.orchestra.run.smithi134.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:03:47.851 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-22 03:03:47,851 seastar - Reactor backend: linux-aio 2024-09-22T03:03:47.879 INFO:teuthology.orchestra.run.smithi134.stderr:==27700==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:03:52.985 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-22T03:03:52.985 INFO:teuthology.orchestra.run.smithi134.stderr:Suppressions used: 2024-09-22T03:03:52.985 INFO:teuthology.orchestra.run.smithi134.stderr: count bytes template 2024-09-22T03:03:52.985 INFO:teuthology.orchestra.run.smithi134.stderr: 1 8 MallocExtension::Register 2024-09-22T03:03:52.985 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-22T03:03:52.985 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:03:52.985 INFO:teuthology.orchestra.run.smithi134.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid 3c083707-cce1-453e-8e70-29f18e875f9d 2024-09-22T03:03:53.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-22T03:03:53.048 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-22T03:03:53.078 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-22T03:03:53.078 INFO:tasks.ceph:role: osd.2 2024-09-22T03:03:53.079 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-22T03:03:53.079 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T03:03:53.154 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:03:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:03:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:03:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:03:53.155 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:03:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:03:53.155 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:03:53.155 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:03:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:03:53.155 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:03:53.641 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-22T03:03:53.643 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-22T03:03:53.643 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-22T03:03:53.769 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-22T03:03:53.799 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-22T03:03:53.864 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-22T03:03:53.864 INFO:tasks.ceph:role: osd.3 2024-09-22T03:03:53.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-22T03:03:53.864 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T03:03:53.937 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:03:53.937 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:03:53.937 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:03:53.937 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:03:53.937 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:03:53.937 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:03:53.937 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:03:53.937 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:03:53.937 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:03:53.937 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:03:54.391 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-22T03:03:54.394 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-22T03:03:54.394 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-22T03:03:54.483 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-22T03:03:54.512 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:03:55.082 INFO:teuthology.orchestra.run.smithi139.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:03:55.083 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2024-09-22 03:03:55,083 seastar - Reactor backend: linux-aio 2024-09-22T03:03:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:==27388==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:03:55.148 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2024-09-22 03:03:55,147 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:03:55.148 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2024-09-22 03:03:55,147 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-22T03:03:55.148 INFO:teuthology.orchestra.run.smithi139.stderr:DEBUG 2024-09-22 03:03:55,148 [shard 0:main] seastar - reactor::drain 2024-09-22T03:03:55.639 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2024-09-22T03:03:55.639 INFO:teuthology.orchestra.run.smithi139.stderr:Suppressions used: 2024-09-22T03:03:55.639 INFO:teuthology.orchestra.run.smithi139.stderr: count bytes template 2024-09-22T03:03:55.639 INFO:teuthology.orchestra.run.smithi139.stderr: 1 8 MallocExtension::Register 2024-09-22T03:03:55.639 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2024-09-22T03:03:55.639 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-09-22T03:03:55.693 INFO:teuthology.orchestra.run.smithi139.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:03:55.694 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2024-09-22 03:03:55,694 seastar - Reactor backend: linux-aio 2024-09-22T03:03:55.730 INFO:teuthology.orchestra.run.smithi139.stderr:==27385==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:04:00.822 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2024-09-22T03:04:00.822 INFO:teuthology.orchestra.run.smithi139.stderr:Suppressions used: 2024-09-22T03:04:00.822 INFO:teuthology.orchestra.run.smithi139.stderr: count bytes template 2024-09-22T03:04:00.822 INFO:teuthology.orchestra.run.smithi139.stderr: 1 8 MallocExtension::Register 2024-09-22T03:04:00.822 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2024-09-22T03:04:00.822 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-09-22T03:04:00.822 INFO:teuthology.orchestra.run.smithi139.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid 3c083707-cce1-453e-8e70-29f18e875f9d 2024-09-22T03:04:00.859 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-22T03:04:00.884 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:04:01.431 INFO:teuthology.orchestra.run.smithi139.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:04:01.432 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2024-09-22 03:04:01,431 seastar - Reactor backend: linux-aio 2024-09-22T03:04:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:==27574==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:04:01.495 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2024-09-22 03:04:01,494 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:04:01.495 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2024-09-22 03:04:01,494 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-22T03:04:01.495 INFO:teuthology.orchestra.run.smithi139.stderr:DEBUG 2024-09-22 03:04:01,495 [shard 0:main] seastar - reactor::drain 2024-09-22T03:04:01.977 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2024-09-22T03:04:01.977 INFO:teuthology.orchestra.run.smithi139.stderr:Suppressions used: 2024-09-22T03:04:01.977 INFO:teuthology.orchestra.run.smithi139.stderr: count bytes template 2024-09-22T03:04:01.977 INFO:teuthology.orchestra.run.smithi139.stderr: 1 8 MallocExtension::Register 2024-09-22T03:04:01.977 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2024-09-22T03:04:01.977 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-09-22T03:04:02.029 INFO:teuthology.orchestra.run.smithi139.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:04:02.031 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2024-09-22 03:04:02,030 seastar - Reactor backend: linux-aio 2024-09-22T03:04:02.058 INFO:teuthology.orchestra.run.smithi139.stderr:==27572==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:04:07.164 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2024-09-22T03:04:07.164 INFO:teuthology.orchestra.run.smithi139.stderr:Suppressions used: 2024-09-22T03:04:07.164 INFO:teuthology.orchestra.run.smithi139.stderr: count bytes template 2024-09-22T03:04:07.164 INFO:teuthology.orchestra.run.smithi139.stderr: 1 8 MallocExtension::Register 2024-09-22T03:04:07.165 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2024-09-22T03:04:07.165 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-09-22T03:04:07.165 INFO:teuthology.orchestra.run.smithi139.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid 3c083707-cce1-453e-8e70-29f18e875f9d 2024-09-22T03:04:07.204 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-22T03:04:07.228 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-22T03:04:07.229 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:04:07.229 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-22T03:04:07.259 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:04:07.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-22T03:04:07.328 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:04:07.328 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-22T03:04:07.353 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:04:07.353 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-22T03:04:07.417 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:04:07.417 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-22T03:04:07.482 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:04:07.482 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-22T03:04:07.501 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:04:07.501 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-22T03:04:07.538 INFO:tasks.ceph:Adding keys to all mons... 2024-09-22T03:04:07.538 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T03:04:07.569 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-09-22T03:04:07.569 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQANie9mWtgjIxAANE00qz6AoxLEHO/jox6yFA== 2024-09-22T03:04:07.569 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-09-22T03:04:07.569 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQATie9mcZTeNxAA86R+GAVn0zz9K9b3NObtQg== 2024-09-22T03:04:07.569 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2024-09-22T03:04:07.569 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAKie9m7e4oJhAAtt6lQDZwvvPiv+ADR40FRA== 2024-09-22T03:04:07.569 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-09-22T03:04:07.570 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAbie9mVycBLxAAK+JadtcT0JW0abdS727jCQ== 2024-09-22T03:04:07.570 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-09-22T03:04:07.570 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAiie9mHp7iBhAAerphhrvPtIrJ4pjYSmz+kw== 2024-09-22T03:04:07.570 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-22T03:04:07.570 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAKie9mIRAsKRAAA8IfPZCjVyRG5ep9OcYA4A== 2024-09-22T03:04:07.570 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2024-09-22T03:04:07.570 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAKie9mtWy+LBAAxzxlJ0Fq+nUFzXJkpconeQ== 2024-09-22T03:04:07.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:04:07.676 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:04:07.735 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T03:04:07.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:04:07.847 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:04:07.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T03:04:07.962 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T03:04:08.022 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-22T03:04:08.022 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-22T03:04:08.046 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T03:04:08.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:08.142+0000 7f6c38239b40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:08.142+0000 7f6c38239b40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-22T03:04:08.181 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:04:08.236 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-22T03:04:08.237 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-22T03:04:08.237 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-22T03:04:08.279 INFO:tasks.ceph.mon.a:Started 2024-09-22T03:04:08.279 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-22T03:04:08.279 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-22T03:04:08.279 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-22T03:04:08.281 INFO:tasks.ceph.mgr.x:Started 2024-09-22T03:04:08.282 INFO:tasks.ceph:Setting crush tunables to default 2024-09-22T03:04:08.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd crush tunables default 2024-09-22T03:04:08.355 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-22T03:04:08.353+0000 7f98d768bb40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.355 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-22T03:04:08.353+0000 7f98d768bb40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.355 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-22T03:04:08.353+0000 7f98d768bb40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.372 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:08.370+0000 7ff78c014f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:08.380+0000 7f88d326c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.398 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:08.397+0000 7ff78c014f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.398 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:08.397+0000 7ff78c014f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:08.397+0000 7f88d326c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.465 INFO:teuthology.orchestra.run.smithi134.stderr:adjusted tunables profile to default 2024-09-22T03:04:08.477 INFO:tasks.ceph:check_enable_crimson: True 2024-09-22T03:04:08.477 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-22T03:04:08.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-22T03:04:08.493 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:08.491+0000 7ff78c014f00 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-22T03:04:08.533 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:08.532+0000 7ff78c014f00 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-22T03:04:08.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:08.571+0000 7f286226c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:08.579+0000 7f286226c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:08.657 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-22T03:04:08.656+0000 7f98ce9f1640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-22T03:04:08.658 INFO:tasks.ceph.mon.a.smithi134.stderr:Please be aware that this feature is experimental, untested, 2024-09-22T03:04:08.658 INFO:tasks.ceph.mon.a.smithi134.stderr:unsupported, and may result in data corruption, data loss, 2024-09-22T03:04:08.658 INFO:tasks.ceph.mon.a.smithi134.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-22T03:04:08.658 INFO:tasks.ceph.mon.a.smithi134.stderr:feature with important data. 2024-09-22T03:04:08.658 INFO:tasks.ceph.mon.a.smithi134.stderr: 2024-09-22T03:04:08.666 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:08.665+0000 7ff78c014f00 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-22T03:04:08.716 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:08.714+0000 7ff78c014f00 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-22T03:04:08.874 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:08.872+0000 7ff78c014f00 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-22T03:04:08.981 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:08.980+0000 7ff78c014f00 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-22T03:04:09.301 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:09.300+0000 7ff78c014f00 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-22T03:04:09.356 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:09.354+0000 7ff78c014f00 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-22T03:04:09.479 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-22T03:04:09.525 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:04:09.525 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-22T03:04:09.525 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:09.502+0000 7ff78c014f00 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-22T03:04:09.552 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-22T03:04:09.552 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-22T03:04:09.618 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:04:09.618 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-22T03:04:09.643 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-22T03:04:09.643 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-22T03:04:09.708 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new ff5d97d6-a2e2-418e-bafc-bb5c698ac90b 0 2024-09-22T03:04:09.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-22T03:04:09.850+0000 7f3e3bad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:09.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-22T03:04:09.858+0000 7f3e3bad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:09.962 INFO:teuthology.orchestra.run.smithi139.stdout:0 2024-09-22T03:04:09.973 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new a8e1b061-b453-4df2-adaa-7d0dbfd1b5b3 1 2024-09-22T03:04:10.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-22T03:04:10.070+0000 7fa7c9d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:10.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-22T03:04:10.078+0000 7fa7c9d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:10.155 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-09-22T03:04:10.167 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 9bcfb0f2-be7f-4950-a879-546f296b63cc 2 2024-09-22T03:04:10.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-22T03:04:10.263+0000 7fa731e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:10.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-22T03:04:10.271+0000 7fa731e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:10.349 INFO:teuthology.orchestra.run.smithi139.stdout:2 2024-09-22T03:04:10.360 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 593b511d-7c06-4d5e-83e2-d89568e0666b 3 2024-09-22T03:04:10.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-22T03:04:10.455+0000 7f59aacd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:10.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-22T03:04:10.463+0000 7f59aacd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:10.501 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:10.498+0000 7ff78c014f00 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-22T03:04:10.542 INFO:teuthology.orchestra.run.smithi139.stdout:3 2024-09-22T03:04:10.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-22T03:04:10.555 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:10.552+0000 7ff78c014f00 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-22T03:04:10.589 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-22T03:04:10.589 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-22T03:04:10.632 INFO:tasks.ceph.osd.0:Started 2024-09-22T03:04:10.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-22T03:04:10.664 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-22T03:04:10.664 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-22T03:04:10.707 INFO:tasks.ceph.osd.1:Started 2024-09-22T03:04:10.707 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-22T03:04:10.737 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-22T03:04:10.737 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-22T03:04:10.780 INFO:tasks.ceph.osd.2:Started 2024-09-22T03:04:10.780 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-22T03:04:10.808 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-22T03:04:10.809 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-22T03:04:10.851 INFO:tasks.ceph.osd.3:Started 2024-09-22T03:04:10.851 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:04:10.942 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:10.940+0000 7ff78c014f00 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-22T03:04:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:10.968+0000 7f1b7a02c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:10.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:10.977+0000 7f1b7a02c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:11.046 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:11.046 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":7,"fsid":"3c083707-cce1-453e-8e70-29f18e875f9d","created":"2024-09-22T03:04:08.385553+0000","modified":"2024-09-22T03:04:10.540409+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T03:04:10.540409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"ff5d97d6-a2e2-418e-bafc-bb5c698ac90b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a8e1b061-b453-4df2-adaa-7d0dbfd1b5b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9bcfb0f2-be7f-4950-a879-546f296b63cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"593b511d-7c06-4d5e-83e2-d89568e0666b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:04:11.046 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.044+0000 7ff78c014f00 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-22T03:04:11.059 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-22T03:04:11.060 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-22T03:04:11.173 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.171+0000 7ff78c014f00 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-22T03:04:11.228 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.225+0000 7ff78c014f00 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-22T03:04:11.355 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.352+0000 7ff78c014f00 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-22T03:04:11.438 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.435+0000 7ff78c014f00 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-22T03:04:11.464 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T03:04:11.511 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.508+0000 7ff78c014f00 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-22T03:04:11.564 INFO:teuthology.misc.health.smithi134.stderr:2024-09-22T03:04:11.558+0000 7f436230e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:11.567 INFO:teuthology.misc.health.smithi134.stderr:2024-09-22T03:04:11.565+0000 7f436230e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:11.632 INFO:teuthology.misc.health.smithi134.stdout: 2024-09-22T03:04:11.633 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":7,"fsid":"3c083707-cce1-453e-8e70-29f18e875f9d","created":"2024-09-22T03:04:08.385553+0000","modified":"2024-09-22T03:04:10.540409+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T03:04:10.540409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"ff5d97d6-a2e2-418e-bafc-bb5c698ac90b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a8e1b061-b453-4df2-adaa-7d0dbfd1b5b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9bcfb0f2-be7f-4950-a879-546f296b63cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"593b511d-7c06-4d5e-83e2-d89568e0666b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:04:11.643 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-22T03:04:11.701 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.698+0000 7ff78c014f00 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-22T03:04:11.761 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.758+0000 7ff78c014f00 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-22T03:04:11.817 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.814+0000 7ff78c014f00 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-22T03:04:11.891 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.888+0000 7ff78c014f00 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-22T03:04:11.939 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.937+0000 7ff78c014f00 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-22T03:04:11.988 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:11.985+0000 7ff78c014f00 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-22T03:04:12.683 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:12.681+0000 7ff78c014f00 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-22T03:04:13.694 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-22T03:04:13.691+0000 7ff72adb3640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-22T03:04:18.046 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T03:04:18.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-22T03:04:18.149+0000 7f0fafd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:18.157 INFO:teuthology.misc.health.smithi134.stderr:2024-09-22T03:04:18.155+0000 7f0fafd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:18.333 INFO:teuthology.misc.health.smithi134.stdout: 2024-09-22T03:04:18.333 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":10,"fsid":"3c083707-cce1-453e-8e70-29f18e875f9d","created":"2024-09-22T03:04:08.385553+0000","modified":"2024-09-22T03:04:16.701908+0000","last_up_change":"2024-09-22T03:04:16.701908+0000","last_in_change":"2024-09-22T03:04:10.540409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"ff5d97d6-a2e2-418e-bafc-bb5c698ac90b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":3237802792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3237802792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":3237802792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3237802792}]},"public_addr":"172.21.15.134:6801/3237802792","cluster_addr":"172.21.15.134:6802/3237802792","heartbeat_back_addr":"172.21.15.134:6805/3237802792","heartbeat_front_addr":"172.21.15.134:6806/3237802792","state":["exists","up"]},{"osd":1,"uuid":"a8e1b061-b453-4df2-adaa-7d0dbfd1b5b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2010837962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2010837962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":2010837962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2010837962}]},"public_addr":"172.21.15.134:6804/2010837962","cluster_addr":"172.21.15.134:6807/2010837962","heartbeat_back_addr":"172.21.15.134:6809/2010837962","heartbeat_front_addr":"172.21.15.134:6808/2010837962","state":["exists","up"]},{"osd":2,"uuid":"9bcfb0f2-be7f-4950-a879-546f296b63cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":2068530255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2068530255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6809","nonce":2068530255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2068530255}]},"public_addr":"172.21.15.139:6805/2068530255","cluster_addr":"172.21.15.139:6804/2068530255","heartbeat_back_addr":"172.21.15.139:6809/2068530255","heartbeat_front_addr":"172.21.15.139:6808/2068530255","state":["exists","up"]},{"osd":3,"uuid":"593b511d-7c06-4d5e-83e2-d89568e0666b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6803","nonce":2508851681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2508851681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2508851681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":2508851681}]},"public_addr":"172.21.15.139:6803/2508851681","cluster_addr":"172.21.15.139:6802/2508851681","heartbeat_back_addr":"172.21.15.139:6812/2508851681","heartbeat_front_addr":"172.21.15.139:6811/2508851681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:04:18.344 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-22T03:04:18.344 INFO:tasks.ceph:Creating RBD pool 2024-09-22T03:04:18.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-22T03:04:18.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:18.440+0000 7fe5c98d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:18.449+0000 7fe5c98d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:18.727 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'rbd' created 2024-09-22T03:04:18.747 DEBUG:teuthology.orchestra.run.smithi134:> rbd --cluster ceph pool init rbd 2024-09-22T03:04:18.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:18.813+0000 7f5c59a2ed00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:18.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:18.813+0000 7f5c59a2ed00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:18.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:18.817+0000 7f5c59a2ed00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:21.760 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-22T03:04:21.760 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-22T03:04:21.760 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-22T03:04:21.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-22T03:04:21.761 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-22T03:04:21.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:21.862+0000 7f96e0c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:21.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:21.869+0000 7f96e0c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.094 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:22.105 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1642813702},{"type":"v1","addr":"172.21.15.139:6801","nonce":1642813702}]},"active_addr":"172.21.15.139:6801/1642813702","active_change":"2024-09-22T03:04:12.684457+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":2327249122}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":1764545087}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":4239033009}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":3411079505}]}]} 2024-09-22T03:04:22.106 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-22T03:04:22.107 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T03:04:22.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:04:22.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.205+0000 7f7181597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.212+0000 7f7181597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.391 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:22.391 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":14,"fsid":"3c083707-cce1-453e-8e70-29f18e875f9d","created":"2024-09-22T03:04:08.385553+0000","modified":"2024-09-22T03:04:21.730855+0000","last_up_change":"2024-09-22T03:04:16.701908+0000","last_in_change":"2024-09-22T03:04:10.540409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-22T03:04:18.643341+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-09-22T03:04:18.723036+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff5d97d6-a2e2-418e-bafc-bb5c698ac90b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":3237802792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3237802792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":3237802792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3237802792}]},"public_addr":"172.21.15.134:6801/3237802792","cluster_addr":"172.21.15.134:6802/3237802792","heartbeat_back_addr":"172.21.15.134:6805/3237802792","heartbeat_front_addr":"172.21.15.134:6806/3237802792","state":["exists","up"]},{"osd":1,"uuid":"a8e1b061-b453-4df2-adaa-7d0dbfd1b5b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2010837962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2010837962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":2010837962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2010837962}]},"public_addr":"172.21.15.134:6804/2010837962","cluster_addr":"172.21.15.134:6807/2010837962","heartbeat_back_addr":"172.21.15.134:6809/2010837962","heartbeat_front_addr":"172.21.15.134:6808/2010837962","state":["exists","up"]},{"osd":2,"uuid":"9bcfb0f2-be7f-4950-a879-546f296b63cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":2068530255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2068530255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6809","nonce":2068530255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2068530255}]},"public_addr":"172.21.15.139:6805/2068530255","cluster_addr":"172.21.15.139:6804/2068530255","heartbeat_back_addr":"172.21.15.139:6809/2068530255","heartbeat_front_addr":"172.21.15.139:6808/2068530255","state":["exists","up"]},{"osd":3,"uuid":"593b511d-7c06-4d5e-83e2-d89568e0666b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6803","nonce":2508851681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2508851681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2508851681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":2508851681}]},"public_addr":"172.21.15.139:6803/2508851681","cluster_addr":"172.21.15.139:6802/2508851681","heartbeat_back_addr":"172.21.15.139:6812/2508851681","heartbeat_front_addr":"172.21.15.139:6811/2508851681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:04:22.403 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T03:04:22.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:04:22.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.503+0000 7f0eb906c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.510+0000 7f0eb906c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:22.688 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":14,"fsid":"3c083707-cce1-453e-8e70-29f18e875f9d","created":"2024-09-22T03:04:08.385553+0000","modified":"2024-09-22T03:04:21.730855+0000","last_up_change":"2024-09-22T03:04:16.701908+0000","last_in_change":"2024-09-22T03:04:10.540409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-22T03:04:18.643341+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-09-22T03:04:18.723036+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff5d97d6-a2e2-418e-bafc-bb5c698ac90b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":3237802792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3237802792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":3237802792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3237802792}]},"public_addr":"172.21.15.134:6801/3237802792","cluster_addr":"172.21.15.134:6802/3237802792","heartbeat_back_addr":"172.21.15.134:6805/3237802792","heartbeat_front_addr":"172.21.15.134:6806/3237802792","state":["exists","up"]},{"osd":1,"uuid":"a8e1b061-b453-4df2-adaa-7d0dbfd1b5b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2010837962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2010837962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":2010837962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2010837962}]},"public_addr":"172.21.15.134:6804/2010837962","cluster_addr":"172.21.15.134:6807/2010837962","heartbeat_back_addr":"172.21.15.134:6809/2010837962","heartbeat_front_addr":"172.21.15.134:6808/2010837962","state":["exists","up"]},{"osd":2,"uuid":"9bcfb0f2-be7f-4950-a879-546f296b63cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":2068530255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2068530255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6809","nonce":2068530255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2068530255}]},"public_addr":"172.21.15.139:6805/2068530255","cluster_addr":"172.21.15.139:6804/2068530255","heartbeat_back_addr":"172.21.15.139:6809/2068530255","heartbeat_front_addr":"172.21.15.139:6808/2068530255","state":["exists","up"]},{"osd":3,"uuid":"593b511d-7c06-4d5e-83e2-d89568e0666b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6803","nonce":2508851681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2508851681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2508851681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":2508851681}]},"public_addr":"172.21.15.139:6803/2508851681","cluster_addr":"172.21.15.139:6802/2508851681","heartbeat_back_addr":"172.21.15.139:6812/2508851681","heartbeat_front_addr":"172.21.15.139:6811/2508851681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:04:22.701 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T03:04:22.701 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T03:04:22.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T03:04:22.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T03:04:22.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.813+0000 7fcacd357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.813+0000 7f995cf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.813+0000 7f7175a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.813+0000 7f3ad94c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.821+0000 7fcacd357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.822+0000 7f7175a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.822+0000 7f3ad94c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.822+0000 7f995cf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.850 INFO:teuthology.orchestra.run.smithi134.stdout:38654705671 2024-09-22T03:04:22.850 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T03:04:22.852 INFO:teuthology.orchestra.run.smithi134.stdout:42949672966 2024-09-22T03:04:22.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T03:04:22.857 INFO:teuthology.orchestra.run.smithi134.stdout:42949672966 2024-09-22T03:04:22.857 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T03:04:22.860 INFO:teuthology.orchestra.run.smithi134.stdout:42949672966 2024-09-22T03:04:22.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T03:04:22.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.954+0000 7f12c6957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.955+0000 7fe988f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.964+0000 7fe988f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:22.964+0000 7f12c6957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:23.007+0000 7ffbf8317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:23.015+0000 7ffbf8317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:23.020+0000 7fc507397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:23.030+0000 7fc507397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.156 INFO:teuthology.orchestra.run.smithi134.stdout:42949672966 2024-09-22T03:04:23.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2024-09-22T03:04:23.170 DEBUG:teuthology.parallel:result is None 2024-09-22T03:04:23.181 INFO:teuthology.orchestra.run.smithi134.stdout:38654705671 2024-09-22T03:04:23.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-22T03:04:23.194 DEBUG:teuthology.parallel:result is None 2024-09-22T03:04:23.225 INFO:teuthology.orchestra.run.smithi134.stdout:42949672966 2024-09-22T03:04:23.234 INFO:teuthology.orchestra.run.smithi134.stdout:42949672966 2024-09-22T03:04:23.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.3 2024-09-22T03:04:23.239 DEBUG:teuthology.parallel:result is None 2024-09-22T03:04:23.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.2 2024-09-22T03:04:23.248 DEBUG:teuthology.parallel:result is None 2024-09-22T03:04:23.248 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T03:04:23.248 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:23.387+0000 7fd804c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:23.393+0000 7fd804c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.570 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:23.571 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:04:23.583 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-22T03:04:22.843944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108020,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379340,"statfs":{"total":386547056640,"available":386436444160,"internally_reserved":0,"allocated":671744,"data_stored":1894113,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.115542"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.744534+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:21.744534+0000","last_peered":"2024-09-22T03:04:21.744534+0000","last_clean":"2024-09-22T03:04:21.744534+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:21.744534+0000","last_undegraded":"2024-09-22T03:04:21.744534+0000","last_fullsized":"2024-09-22T03:04:21.744534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.745008+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:21.745008+0000","last_peered":"2024-09-22T03:04:21.745008+0000","last_clean":"2024-09-22T03:04:21.745008+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:21.745008+0000","last_undegraded":"2024-09-22T03:04:21.745008+0000","last_fullsized":"2024-09-22T03:04:21.745008+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743429+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:21.743429+0000","last_peered":"2024-09-22T03:04:21.743429+0000","last_clean":"2024-09-22T03:04:21.743429+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:21.743429+0000","last_undegraded":"2024-09-22T03:04:21.743429+0000","last_fullsized":"2024-09-22T03:04:21.743429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.741825+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:21.741825+0000","last_peered":"2024-09-22T03:04:21.741825+0000","last_clean":"2024-09-22T03:04:21.741825+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:21.741825+0000","last_undegraded":"2024-09-22T03:04:21.741825+0000","last_fullsized":"2024-09-22T03:04:21.741825+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743144+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:21.743144+0000","last_peered":"2024-09-22T03:04:21.743144+0000","last_clean":"2024-09-22T03:04:21.743144+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:21.743144+0000","last_undegraded":"2024-09-22T03:04:21.743144+0000","last_fullsized":"2024-09-22T03:04:21.743144+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743241+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:21.743241+0000","last_peered":"2024-09-22T03:04:21.743241+0000","last_clean":"2024-09-22T03:04:21.743241+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:21.743241+0000","last_undegraded":"2024-09-22T03:04:21.743241+0000","last_fullsized":"2024-09-22T03:04:21.743241+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"13'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743308+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:21.743308+0000","last_peered":"2024-09-22T03:04:21.743308+0000","last_clean":"2024-09-22T03:04:21.743308+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:21.743308+0000","last_undegraded":"2024-09-22T03:04:21.743308+0000","last_fullsized":"2024-09-22T03:04:21.743308+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.740600+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:21.740600+0000","last_peered":"2024-09-22T03:04:21.740600+0000","last_clean":"2024-09-22T03:04:21.740600+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:21.740600+0000","last_undegraded":"2024-09-22T03:04:21.740600+0000","last_fullsized":"2024-09-22T03:04:21.740600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.740684+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:21.740684+0000","last_peered":"2024-09-22T03:04:21.740684+0000","last_clean":"2024-09-22T03:04:21.740684+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:21.740684+0000","last_undegraded":"2024-09-22T03:04:21.740684+0000","last_fullsized":"2024-09-22T03:04:21.740684+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":30757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":180224,"data_stored":621106,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:23.584 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:23.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:23.682+0000 7f7ffb258640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:23.689+0000 7f7ffb258640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.866 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:23.867 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:04:23.879 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-22T03:04:22.843944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108020,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379340,"statfs":{"total":386547056640,"available":386436444160,"internally_reserved":0,"allocated":671744,"data_stored":1894113,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.115542"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.744534+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:21.744534+0000","last_peered":"2024-09-22T03:04:21.744534+0000","last_clean":"2024-09-22T03:04:21.744534+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:21.744534+0000","last_undegraded":"2024-09-22T03:04:21.744534+0000","last_fullsized":"2024-09-22T03:04:21.744534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.745008+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:21.745008+0000","last_peered":"2024-09-22T03:04:21.745008+0000","last_clean":"2024-09-22T03:04:21.745008+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:21.745008+0000","last_undegraded":"2024-09-22T03:04:21.745008+0000","last_fullsized":"2024-09-22T03:04:21.745008+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743429+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:21.743429+0000","last_peered":"2024-09-22T03:04:21.743429+0000","last_clean":"2024-09-22T03:04:21.743429+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:21.743429+0000","last_undegraded":"2024-09-22T03:04:21.743429+0000","last_fullsized":"2024-09-22T03:04:21.743429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.741825+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:21.741825+0000","last_peered":"2024-09-22T03:04:21.741825+0000","last_clean":"2024-09-22T03:04:21.741825+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:21.741825+0000","last_undegraded":"2024-09-22T03:04:21.741825+0000","last_fullsized":"2024-09-22T03:04:21.741825+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743144+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:21.743144+0000","last_peered":"2024-09-22T03:04:21.743144+0000","last_clean":"2024-09-22T03:04:21.743144+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:21.743144+0000","last_undegraded":"2024-09-22T03:04:21.743144+0000","last_fullsized":"2024-09-22T03:04:21.743144+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743241+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:21.743241+0000","last_peered":"2024-09-22T03:04:21.743241+0000","last_clean":"2024-09-22T03:04:21.743241+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:21.743241+0000","last_undegraded":"2024-09-22T03:04:21.743241+0000","last_fullsized":"2024-09-22T03:04:21.743241+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"13'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743308+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:21.743308+0000","last_peered":"2024-09-22T03:04:21.743308+0000","last_clean":"2024-09-22T03:04:21.743308+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:21.743308+0000","last_undegraded":"2024-09-22T03:04:21.743308+0000","last_fullsized":"2024-09-22T03:04:21.743308+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.740600+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:21.740600+0000","last_peered":"2024-09-22T03:04:21.740600+0000","last_clean":"2024-09-22T03:04:21.740600+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:21.740600+0000","last_undegraded":"2024-09-22T03:04:21.740600+0000","last_fullsized":"2024-09-22T03:04:21.740600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.740684+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:21.740684+0000","last_peered":"2024-09-22T03:04:21.740684+0000","last_clean":"2024-09-22T03:04:21.740684+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:21.740684+0000","last_undegraded":"2024-09-22T03:04:21.740684+0000","last_fullsized":"2024-09-22T03:04:21.740684+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":30757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":180224,"data_stored":621106,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:23.879 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T03:04:23.879 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-22T03:04:23.879 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-22T03:04:23.880 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-22T03:04:23.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:23.978+0000 7fd218397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:23.983+0000 7fd218397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:24.196 INFO:teuthology.orchestra.run.smithi134.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-22T03:04:24.208 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-22T03:04:24.208 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-22T03:04:24.218 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-22T03:04:24.218 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'squid', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}} 2024-09-22T03:04:24.218 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-22T03:04:24.218 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-22T03:04:24.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:24.317+0000 7f219e66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:24.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:24.327+0000 7f219e66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:24.520 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-22T03:04:24.520 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T03:04:24.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:24.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:24.619+0000 7fa009717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:24.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:24.625+0000 7fa009717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:24.802 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:04:24.814 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-22T03:04:24.691504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108020,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379340,"statfs":{"total":386547056640,"available":386436444160,"internally_reserved":0,"allocated":671744,"data_stored":1894113,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.963102"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.744534+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:21.744534+0000","last_peered":"2024-09-22T03:04:21.744534+0000","last_clean":"2024-09-22T03:04:21.744534+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:21.744534+0000","last_undegraded":"2024-09-22T03:04:21.744534+0000","last_fullsized":"2024-09-22T03:04:21.744534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.745008+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:21.745008+0000","last_peered":"2024-09-22T03:04:21.745008+0000","last_clean":"2024-09-22T03:04:21.745008+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:21.745008+0000","last_undegraded":"2024-09-22T03:04:21.745008+0000","last_fullsized":"2024-09-22T03:04:21.745008+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743429+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:21.743429+0000","last_peered":"2024-09-22T03:04:21.743429+0000","last_clean":"2024-09-22T03:04:21.743429+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:21.743429+0000","last_undegraded":"2024-09-22T03:04:21.743429+0000","last_fullsized":"2024-09-22T03:04:21.743429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.741825+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:21.741825+0000","last_peered":"2024-09-22T03:04:21.741825+0000","last_clean":"2024-09-22T03:04:21.741825+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:21.741825+0000","last_undegraded":"2024-09-22T03:04:21.741825+0000","last_fullsized":"2024-09-22T03:04:21.741825+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743144+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:21.743144+0000","last_peered":"2024-09-22T03:04:21.743144+0000","last_clean":"2024-09-22T03:04:21.743144+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:21.743144+0000","last_undegraded":"2024-09-22T03:04:21.743144+0000","last_fullsized":"2024-09-22T03:04:21.743144+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743241+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:21.743241+0000","last_peered":"2024-09-22T03:04:21.743241+0000","last_clean":"2024-09-22T03:04:21.743241+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:21.743241+0000","last_undegraded":"2024-09-22T03:04:21.743241+0000","last_fullsized":"2024-09-22T03:04:21.743241+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"13'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743308+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:21.743308+0000","last_peered":"2024-09-22T03:04:21.743308+0000","last_clean":"2024-09-22T03:04:21.743308+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:21.743308+0000","last_undegraded":"2024-09-22T03:04:21.743308+0000","last_fullsized":"2024-09-22T03:04:21.743308+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.740600+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:21.740600+0000","last_peered":"2024-09-22T03:04:21.740600+0000","last_clean":"2024-09-22T03:04:21.740600+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:21.740600+0000","last_undegraded":"2024-09-22T03:04:21.740600+0000","last_fullsized":"2024-09-22T03:04:21.740600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.740684+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:21.740684+0000","last_peered":"2024-09-22T03:04:21.740684+0000","last_clean":"2024-09-22T03:04:21.740684+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:21.740684+0000","last_undegraded":"2024-09-22T03:04:21.740684+0000","last_fullsized":"2024-09-22T03:04:21.740684+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":30757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":180224,"data_stored":621106,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:24.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:24.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:24.956+0000 7fadc570e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:24.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:24.963+0000 7fadc570e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:25.138 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:25.138 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:04:25.150 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-22T03:04:24.691504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108020,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379340,"statfs":{"total":386547056640,"available":386436444160,"internally_reserved":0,"allocated":671744,"data_stored":1894113,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.963102"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.744534+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:21.744534+0000","last_peered":"2024-09-22T03:04:21.744534+0000","last_clean":"2024-09-22T03:04:21.744534+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:21.744534+0000","last_undegraded":"2024-09-22T03:04:21.744534+0000","last_fullsized":"2024-09-22T03:04:21.744534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.745008+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:21.745008+0000","last_peered":"2024-09-22T03:04:21.745008+0000","last_clean":"2024-09-22T03:04:21.745008+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:21.745008+0000","last_undegraded":"2024-09-22T03:04:21.745008+0000","last_fullsized":"2024-09-22T03:04:21.745008+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743429+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:21.743429+0000","last_peered":"2024-09-22T03:04:21.743429+0000","last_clean":"2024-09-22T03:04:21.743429+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:21.743429+0000","last_undegraded":"2024-09-22T03:04:21.743429+0000","last_fullsized":"2024-09-22T03:04:21.743429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.741825+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:21.741825+0000","last_peered":"2024-09-22T03:04:21.741825+0000","last_clean":"2024-09-22T03:04:21.741825+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:21.741825+0000","last_undegraded":"2024-09-22T03:04:21.741825+0000","last_fullsized":"2024-09-22T03:04:21.741825+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743144+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:21.743144+0000","last_peered":"2024-09-22T03:04:21.743144+0000","last_clean":"2024-09-22T03:04:21.743144+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:21.743144+0000","last_undegraded":"2024-09-22T03:04:21.743144+0000","last_fullsized":"2024-09-22T03:04:21.743144+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743241+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:21.743241+0000","last_peered":"2024-09-22T03:04:21.743241+0000","last_clean":"2024-09-22T03:04:21.743241+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:21.743241+0000","last_undegraded":"2024-09-22T03:04:21.743241+0000","last_fullsized":"2024-09-22T03:04:21.743241+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"13'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743308+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:21.743308+0000","last_peered":"2024-09-22T03:04:21.743308+0000","last_clean":"2024-09-22T03:04:21.743308+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:21.743308+0000","last_undegraded":"2024-09-22T03:04:21.743308+0000","last_fullsized":"2024-09-22T03:04:21.743308+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.740600+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:21.740600+0000","last_peered":"2024-09-22T03:04:21.740600+0000","last_clean":"2024-09-22T03:04:21.740600+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:21.740600+0000","last_undegraded":"2024-09-22T03:04:21.740600+0000","last_fullsized":"2024-09-22T03:04:21.740600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.740684+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:21.740684+0000","last_peered":"2024-09-22T03:04:21.740684+0000","last_clean":"2024-09-22T03:04:21.740684+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:21.740684+0000","last_undegraded":"2024-09-22T03:04:21.740684+0000","last_fullsized":"2024-09-22T03:04:21.740684+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":30757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":180224,"data_stored":621106,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:25.151 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T03:04:25.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-22T03:04:25.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:25.251+0000 7fef51c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:25.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:25.257+0000 7fef51c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:25.441 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-09-22T03:04:25.441 INFO:teuthology.orchestra.run.smithi134.stdout:fsid 3c083707-cce1-453e-8e70-29f18e875f9d 2024-09-22T03:04:25.441 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-09-22T03:04:08.385553+0000 2024-09-22T03:04:25.441 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-09-22T03:04:21.730855+0000 2024-09-22T03:04:25.441 INFO:teuthology.orchestra.run.smithi134.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-22T03:04:25.441 INFO:teuthology.orchestra.run.smithi134.stdout:crush_version 4 2024-09-22T03:04:25.441 INFO:teuthology.orchestra.run.smithi134.stdout:full_ratio 0.95 2024-09-22T03:04:25.441 INFO:teuthology.orchestra.run.smithi134.stdout:backfillfull_ratio 0.9 2024-09-22T03:04:25.441 INFO:teuthology.orchestra.run.smithi134.stdout:nearfull_ratio 0.85 2024-09-22T03:04:25.441 INFO:teuthology.orchestra.run.smithi134.stdout:require_min_compat_client luminous 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:min_compat_client jewel 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:require_osd_release squid 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:stretch_mode_enabled false 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:allow_crimson=true 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 14 flags hashpspool,nopgchange,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 1.50 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: removed_snaps_queue [2~1] 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:pool 2 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 13 flags hashpspool,nopgchange,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:max_osd 4 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 up in weight 1 up_from 9 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.134:6801/3237802792 v2:172.21.15.134:6802/3237802792 exists,up ff5d97d6-a2e2-418e-bafc-bb5c698ac90b 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.134:6804/2010837962 v2:172.21.15.134:6807/2010837962 exists,up a8e1b061-b453-4df2-adaa-7d0dbfd1b5b3 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.139:6805/2068530255 v2:172.21.15.139:6804/2068530255 exists,up 9bcfb0f2-be7f-4950-a879-546f296b63cc 2024-09-22T03:04:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.139:6803/2508851681 v2:172.21.15.139:6802/2508851681 exists,up 593b511d-7c06-4d5e-83e2-d89568e0666b 2024-09-22T03:04:25.453 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.134:6801/3237802792 v2:172.21.15.134:6802/3237802792 exists,up ff5d97d6-a2e2-418e-bafc-bb5c698ac90b', 'osd.1 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.134:6804/2010837962 v2:172.21.15.134:6807/2010837962 exists,up a8e1b061-b453-4df2-adaa-7d0dbfd1b5b3', 'osd.2 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.139:6805/2068530255 v2:172.21.15.139:6804/2068530255 exists,up 9bcfb0f2-be7f-4950-a879-546f296b63cc', 'osd.3 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.139:6803/2508851681 v2:172.21.15.139:6802/2508851681 exists,up 593b511d-7c06-4d5e-83e2-d89568e0666b'] 2024-09-22T03:04:25.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-22T03:04:25.558 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-22T03:04:25.558 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mon.a", 2024-09-22T03:04:25.558 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster": "ceph", 2024-09-22T03:04:25.558 INFO:teuthology.orchestra.run.smithi134.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-22T03:04:25.558 INFO:teuthology.orchestra.run.smithi134.stdout: "admin_socket_mode": "", 2024-09-22T03:04:25.558 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-22T03:04:25.558 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_client_required": "cephx, none", 2024-09-22T03:04:25.558 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_cluster_required": "cephx", 2024-09-22T03:04:25.558 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_debug": "true", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_service_required": "cephx", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_supported": "cephx", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_aio": "true", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_aio_poll_ms": "250", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_aio_reap_max": "16", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_async_discard": "false", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_block_size": "4096", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_debug_aio": "false", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-22T03:04:25.559 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_debug_inflight_ios": "false", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_enable_discard": "false", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_flock_retry": "3", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_inject_crash": "0", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_ioring": "false", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_ioring_hipri": "false", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-22T03:04:25.560 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_type": "", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_alloc_size": "1048576", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_allocator": "hybrid", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_buffered_io": "true", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_check_for_zeros": "false", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_compact_log_sync": "false", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_max_log_runway": "4194304", 2024-09-22T03:04:25.561 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_max_prefetch": "1048576", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_min_flush_size": "524288", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_min_log_runway": "1048576", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_replay_recovery": "false", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_sync_write": "false", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_allocation_from_file": "true", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_allocator": "hybrid", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-22T03:04:25.562 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bdev_label_multi": "true", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_create": "true", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_db_create": "false", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_db_path": "", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_db_size": "0", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_path": "", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_preallocate_file": "false", 2024-09-22T03:04:25.563 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_size": "107374182400", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_wal_create": "false", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_wal_path": "", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_wal_size": "100663296", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bluefs": "true", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_autotune": "true", 2024-09-22T03:04:25.564 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_size": "0", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_type": "2q", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_clone_cow": "true", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-22T03:04:25.565 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_mode": "none", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_csum_type": "crc32c", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_freelist": "false", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-22T03:04:25.566 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_small_allocations": "0", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_default_buffered_read": "true", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_default_buffered_write": "false", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-22T03:04:25.567 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fail_eio": "false", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_mount": "false", 2024-09-22T03:04:25.568 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_umount": "false", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_ignore_data_csum": "false", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-22T03:04:25.569 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_log_op_age": "5.000000", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_alloc_size": "0", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_blob_size": "0", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_deferred_txc": "32", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_min_alloc_size": "0", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_nid_prealloc": "1024", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-22T03:04:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_retry_disk_reads": "3", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_rocksdb_cf": "true", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_spdk_mem": "512", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-22T03:04:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_tracing": "false", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-22T03:04:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_zero_block_detection": "false", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-22T03:04:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_cluster_require_signatures": "false", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_cluster_require_version": "2", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_require_signatures": "false", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_require_version": "2", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_service_require_signatures": "false", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_service_require_version": "2", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_sign_messages": "true", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "chdir": "", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_acl_type": "", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_asio_thread_count": "2", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_cache_mid": "0.750000", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_cache_size": "16384", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_caps_release_delay": "5", 2024-09-22T03:04:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_check_pool_perm": "true", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_debug_force_sync_read": "false", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_debug_getattr_caps": "false", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_debug_inject_features": "", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_debug_inject_tick_delay": "0", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_die_on_failed_remount": "false", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_dirsize_rbytes": "true", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_force_lazyio": "false", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_fs": "", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_inject_release_failure": "false", 2024-09-22T03:04:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_max_inline_size": "4096", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_mds_namespace": "", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_metadata": "", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_mount_gid": "-1", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_mount_timeout": "300", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_mount_uid": "-1", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_mountpoint": "/", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_notify_timeout": "10", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc": "true", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc_max_dirty": "104857600", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc_max_objects": "1000", 2024-09-22T03:04:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc_size": "209715200", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc_target_dirty": "8388608", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_permissions": "true", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_quota": "true", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_quota_df": "true", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_readahead_max_bytes": "0", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_readahead_max_periods": "4", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_readahead_min": "131072", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_reconnect_stale": "false", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_shutdown_timeout": "30", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_snapdir": ".snap", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_tick_interval": "1", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_trace": "", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_try_dentry_invalidate": "false", 2024-09-22T03:04:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_use_faked_inos": "false", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client_use_random_mds": "false", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_graylog": "false", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_graylog_port": "12201", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_monitors": "default=true", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_syslog": "false", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_syslog_level": "info", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "-", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_network": "", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_network_interface": "", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "compressor_zlib_isal": "false", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "compressor_zlib_level": "5", 2024-09-22T03:04:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "compressor_zlib_winsize": "-15", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "compressor_zstd_level": "1", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_alien_op_num_threads": "6", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_osd_stat_interval": "0", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_seastar_cpu_cores": "", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_seastar_num_threads": "0", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_location": "", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_location_hook": "", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_location_hook_timeout": "10", 2024-09-22T03:04:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "daemonize": "false", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "daos_pool": "tank", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_alienstore": "0/5", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_allow_any_pool_priority": "false", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_asok": "1/5", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_asok_assert_abort": "false", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_asserts_on_shutdown": "true", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_auth": "20/20", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_bdev": "1/3", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_bluefs": "1/5", 2024-09-22T03:04:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_bluestore": "1/5", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_buffer": "0/1", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_ceph_exporter": "1/5", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_cephfs_mirror": "0/5", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_cephsqlite": "0/5", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_client": "0/5", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_compressor": "1/5", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_context": "0/1", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_crimson_interrupt": "0/5", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_crush": "1/1", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_crypto": "1/5", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_cyanstore": "0/5", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_deliberately_leak_memory": "false", 2024-09-22T03:04:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_disable_randomized_ping": "false", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_dpdk": "1/5", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_eventtrace": "1/5", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_filer": "0/1", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_filestore": "1/3", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_finisher": "1/1", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_fuse": "1/5", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_heartbeat_testing_span": "0", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_heartbeatmap": "1/5", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_javaclient": "1/5", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_journal": "1/3", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_journaler": "0/5", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_kstore": "1/5", 2024-09-22T03:04:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_lockdep": "0/1", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mclock": "1/5", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds": "1/5", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_balancer": "1/5", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_locker": "1/5", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_log": "1/5", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_log_expire": "1/5", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_migrator": "1/5", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_quiesce": "3/5", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_memstore": "1/5", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mgr": "2/5", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mgrc": "1/5", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mon": "20/20", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_monc": "0/10", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_ms": "1/1", 2024-09-22T03:04:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_none": "0/5", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_objclass": "0/5", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_objectcacher": "0/5", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_objecter": "0/1", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_optracker": "0/5", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_osd": "1/5", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_paxos": "20/20", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_perfcounter": "1/5", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_prioritycache": "1/5", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rados": "0/5", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rbd": "0/5", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rbd_mirror": "0/5", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rbd_pwl": "0/5", 2024-09-22T03:04:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rbd_replay": "0/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_refs": "0/0", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_reserver": "1/1", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw": "1/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_access": "1/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_datacache": "1/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_dbstore": "1/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_flight": "1/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_sync": "1/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rocksdb": "4/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore": "0/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_backref": "0/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_cache": "0/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_cleaner": "0/5", 2024-09-22T03:04:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_device": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_epm": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_journal": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_lba": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_odata": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_omap": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_onode": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_t": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_tm": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_striper": "0/1", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_test": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_throttle": "1/1", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_timer": "0/1", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_tp": "0/5", 2024-09-22T03:04:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_trace": "1/5", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "device_failure_prediction_mode": "none", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "err_to_graylog": "false", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "err_to_journald": "false", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "err_to_stderr": "true", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "err_to_syslog": "false", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event_tracing": "false", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_addr": "0.0.0.0", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_http_port": "9926", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_prio_limit": "5", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_sort_metrics": "true", 2024-09-22T03:04:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_stats_period": "5", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "fake_statfs_for_testing": "0", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "fatal_signal_handlers": "true", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filer_max_purge_ops": "10", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filer_max_truncate_ops": "128", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_apply_finisher_threads": "1", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_blackhole": "false", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_btrfs_clone_range": "true", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_btrfs_snap": "true", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_caller_concurrency": "10", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_collect_device_partition_information": "true", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_commit_timeout": "600.000000", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_debug_inject_read_err": "false", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_debug_omap_check": "false", 2024-09-22T03:04:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_debug_verify_split": "false", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_dump_file": "", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fadvise": "true", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fail_eio": "true", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fd_cache_shards": "16", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fd_cache_size": "128", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fiemap": "false", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fiemap_threshold": "4096", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_inject_stall": "0", 2024-09-22T03:04:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_journal_parallel": "false", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_journal_trailing": "false", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_journal_writeahead": "false", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_kill_at": "0", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattrs": "0", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-22T03:04:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_xattr_value_size": "0", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_merge_threshold": "-10", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_odsync_write": "false", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_omap_backend": "rocksdb", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_omap_backend_path": "", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_op_thread_timeout": "60", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_op_threads": "2", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_punch_hole": "false", 2024-09-22T03:04:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_max_ops": "50", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_seek_data_hole": "false", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_sloppy_crc": "false", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_splice": "false", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_split_multiple": "2", 2024-09-22T03:04:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_split_rand_factor": "20", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_update_to": "1000", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_enable": "true", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-22T03:04:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_xfs_extsize": "false", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_zfs_snap": "false", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fio_dir": "/tmp/fio", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fsid": "3c083707-cce1-453e-8e70-29f18e875f9d", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_allow_other": "true", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_atomic_o_trunc": "true", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_big_writes": "true", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_debug": "false", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_default_permissions": "false", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_disable_pagecache": "false", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_max_write": "0", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_multithreaded": "true", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_require_active_mds": "true", 2024-09-22T03:04:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_set_user_groups": "true", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_splice_move": "true", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_splice_read": "true", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_splice_write": "true", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_use_invalidate_cb": "true", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "gss_target_name": "ceph", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_file": "", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_inject_failure": "0", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_interval": "5", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "host": "smithi134", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-22T03:04:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "inject_early_sigterm": "false", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "jaeger_agent_port": "6799", 2024-09-22T03:04:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "jaeger_tracing_enable": "false", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_aio": "true", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_align_min_size": "65536", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_block_align": "true", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_block_size": "4096", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_dio": "true", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_discard": "false", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_force_aio": "false", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_ignore_corruption": "false", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_max_write_bytes": "10485760", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_max_write_entries": "100", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_replay_from": "0", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-22T03:04:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_write_header_frequency": "0", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_zero_on_create": "false", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "journaler_prefetch_periods": "10", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "journaler_prezero_periods": "5", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "journaler_write_head_interval": "15", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "keyfile": "", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_backend": "rocksdb", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_default_stripe_size": "65536", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_fsck_on_mount": "false", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_max_bytes": "67108864", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_max_ops": "512", 2024-09-22T03:04:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_nid_prealloc": "1024", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_onode_map_size": "1024", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_sync_submit_transaction": "false", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_sync_transaction": "false", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "librados_thread_count": "2", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "lockdep": "false", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "lockdep_force_backtrace": "false", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "log_coarse_timestamps": "true", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "log_flush_on_exit": "false", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "log_graylog_host": "127.0.0.1", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "log_graylog_port": "12201", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "log_max_new": "1000", 2024-09-22T03:04:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "log_max_recent": "10000", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "log_stderr_prefix": "", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "log_stop_at_utilization": "0.970000", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": "true", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_graylog": "false", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_journald": "false", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_stderr": "false", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_syslog": "false", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "max_rotating_auth_attempts": "10", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_action_on_write_error": "1", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_alternate_name_max": "8192", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_asio_thread_count": "2", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_export_pin": "true", 2024-09-22T03:04:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_fragment_dirs": "true", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_fragment_interval": "5", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_interval": "10", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_max": "-1", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_max_until": "-1", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_merge_size": "50", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_midchunk": "0.300000", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_min_start": "0.200000", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_minchunk": "0.001000", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_mode": "0", 2024-09-22T03:04:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_need_max": "1.200000", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_need_min": "0.800000", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_overload_epochs": "2", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_split_bits": "3", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_split_size": "10000", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_target_decay": "10.000000", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_beacon_grace": "15.000000", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_beacon_interval": "4.000000", 2024-09-22T03:04:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_mid": "0.700000", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_quiesce_delay": "0", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_release_free_interval": "10", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_reservation": "0.050000", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_trim_interval": "1", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_trim_threshold": "262144", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-22T03:04:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_client_prealloc_inos": "1000", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_connect_bootstrapping": "false", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_damage_table_max_entries": "10000", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_debug_auth_pins": "false", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_debug_frag": "false", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_debug_scatterstat": "false", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_debug_subtrees": "false", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_decay_halflife": "5.000000", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_default_dir_hash": "2", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_defer_session_stale": "true", 2024-09-22T03:04:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_deny_all_reconnect": "false", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dir_keys_per_op": "16384", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dir_max_commit_size": "10", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dir_max_entries": "0", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dir_prefetch": "true", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dump_cache_on_map": "false", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_early_reply": "true", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_enable_op_tracker": "true", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_enforce_unique_name": "true", 2024-09-22T03:04:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_export_ephemeral_random": "true", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_health_summarize_threshold": "10", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-22T03:04:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_health_dummy": "false", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_migrator_session_race": "false", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_join_fs": "", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_journal_format": "1", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_create_at": "0", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_export_at": "0", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_import_at": "0", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_journal_at": "0", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_journal_expire_at": "0", 2024-09-22T03:04:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_journal_replay_at": "0", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_link_at": "0", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_mdstable_at": "0", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_openc_at": "0", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_rename_at": "0", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_shutdown_at": "0", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_event_large_threshold": "524288", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_events_per_segment": "1024", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_max_events": "-1", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_max_segments": "128", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_pause": "false", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_segment_size": "0", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-22T03:04:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_trim_threshold": "128", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_warn_factor": "2.000000", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_caps_per_client": "1048576", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_completed_flushes": "100000", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_completed_requests": "100000", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_export_size": "20971520", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_file_recover": "32", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_purge_files": "64", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_purge_ops": "8192", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_snaps_per_dir": "100", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_metrics_update_interval": "2", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_min_caps_per_client": "100", 2024-09-22T03:04:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_min_caps_working_set": "10000", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_numa_node": "-1", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_complaint_time": "30.000000", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_history_duration": "600", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_history_size": "20", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_history_slow_op_size": "20", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_log_threshold": "5", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_ping_grace": "15", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_ping_interval": "5", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-22T03:04:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_max_caps": "30000", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_warning_threshold": "262144", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_replay_interval": "1.000000", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_root_ino_gid": "0", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_root_ino_uid": "0", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-22T03:04:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_shutdown_check": "0", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_skip_ino": "0", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_snap_max_uid": "4294967294", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_snap_min_uid": "0", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_snap_rstat": "false", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_standby_replay_damaged": "false", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_symlink_recovery": "true", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-22T03:04:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_thrash_exports": "0", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_thrash_fragments": "0", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_tick_interval": "5.000000", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_valgrind_exit": "false", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_verify_backtrace": "1", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_verify_scatter": "false", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_wipe_sessions": "false", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool_debug": "false", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "memstore_device_bytes": "1073741824", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "memstore_page_set": "false", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "memstore_page_size": "65536", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_client_bytes": "134217728", 2024-09-22T03:04:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_client_messages": "512", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_disabled_modules": "", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_enable_op_tracker": "true", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_max_pg_num_change": "128", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_mds_bytes": "134217728", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_mds_messages": "128", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_mon_bytes": "134217728", 2024-09-22T03:04:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_mon_messages": "128", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_history_duration": "600", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_history_size": "20", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_log_threshold": "5", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_osd_bytes": "536870912", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_osd_messages": "8192", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_pool": "true", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_standby_modules": "true", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_stats_period": "5", 2024-09-22T03:04:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_stats_threshold": "5", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_tick_period": "2", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_allow_pool_delete": "true", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_allow_pool_size_one": "true", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_auth_validate_all_caps": "true", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_bytes": "104857600", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_directed_command_retry": "2", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-22T03:04:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_hunt_parallel": "3", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_log_interval": "1.000000", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_ping_interval": "10.000000", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_target_rank": "-1", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_file_level": "debug", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_file": "true", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_journald": "false", 2024-09-22T03:04:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_compact_on_bootstrap": "false", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_compact_on_start": "false", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_compact_on_trim": "true", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cpu_threads": "4", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_crush_min_required_version": "hammer", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_daemon_bytes": "419430400", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_data_avail_crit": "5", 2024-09-22T03:04:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_data_avail_warn": "5", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_data_size_warn": "16106127360", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_dump_json": "false", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_dump_transactions": "false", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_extra_checks": "false", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_no_require_reef": "false", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_no_require_squid": "false", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-22T03:04:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_down_mkfs_grace": "120", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_down_uptime_grace": "60", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_election_default_strategy": "1", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_election_timeout": "5.000000", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_elector_ping_divisor": "2", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_enable_op_tracker": "true", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_fake_pool_delete": "false", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_force_quorum_join": "false", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_globalid_prealloc": "10000", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_detail_to_clog": "false", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_log_update_period": "5", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_max_detail": "50", 2024-09-22T03:04:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_to_clog": "true", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_to_clog_interval": "600", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_host": "172.21.15.134", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_host_override": "", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_initial_members": "", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_lease": "5.000000", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-22T03:04:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_log_full_interval": "50", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_log_max": "10000", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_log_max_summary": "50", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_log_epochs": "500", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_osd": "10000", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_pg_per_osd": "10000", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_pool_pg_num": "65536", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mds_force_trim_to": "0", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mds_skip_sanity": "false", 2024-09-22T03:04:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_memory_autotune": "true", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_memory_target": "2147483648", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_beacon_grace": "30", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_digest_period": "5", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_inactive_grace": "60", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_min_osdmap_epochs": "50", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_complaint_time": "30", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_history_duration": "600", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_history_size": "20", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_history_slow_op_size": "20", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_log_threshold": "5", 2024-09-22T03:04:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_auto_mark_in": "false", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_cache_size": "500", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_down_out_interval": "600", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_force_trim_to": "0", 2024-09-22T03:04:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_min_down_reporters": "2", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_report_timeout": "900", 2024-09-22T03:04:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osdmap_full_prune_interval": "2", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osdmap_full_prune_min": "15", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_stuck_threshold": "60", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-22T03:04:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_probe_timeout": "2.000000", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_reweight_max_change": "0.050000", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_reweight_max_osds": "4", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_scrub_interval": "86400", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_scrub_max_keys": "100", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_scrub_timeout": "300", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_session_timeout": "300", 2024-09-22T03:04:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_smart_report_timeout": "5", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_stat_smooth_intervals": "6", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_stretch_pool_min_size": "2", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_stretch_pool_size": "4", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_debug": "false", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_provider_kill_at": "0", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_requester_kill_at": "0", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_timeout": "60.000000", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_target_pg_per_osd": "100", 2024-09-22T03:04:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_tick_interval": "5", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_timecheck_interval": "300.000000", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_use_min_delay_socket": "false", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_older_version_delay": "604800", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_misplaced": "false", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-22T03:04:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_older_version": "true", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "monmap": "", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-22T03:04:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_tracing_enabled": "false", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_op_threads": "3", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_cm": "false", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_device_name": "", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_dscp": "96", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_local_gid": "", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_port_num": "1", 2024-09-22T03:04:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_sl": "3", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_support_srq": "true", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_type": "ib", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_reap_threshold": "5", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_before_connect": "false", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_ipv4": "true", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_ipv6": "false", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_msgr1": "true", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_msgr2": "true", 2024-09-22T03:04:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_port_max": "7568", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_port_min": "6800", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_retry_count": "3", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_retry_delay": "5", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_blackhole_client": "false", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_blackhole_mds": "false", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_blackhole_mgr": "false", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_blackhole_mon": "false", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_blackhole_osd": "false", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_client_mode": "crc", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_cluster_mode": "crc", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_cluster_type": "", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_compress_secure": "false", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_connection_idle_timeout": "900", 2024-09-22T03:04:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_connection_ready_timeout": "10", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_crc_data": "true", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_crc_header": "true", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_die_on_bad_msg": "false", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_die_on_bug": "true", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_die_on_old_message": "true", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_die_on_skipped_message": "false", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_coremask": "0xF", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_enable_tso": "true", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-22T03:04:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_hugepages": "", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_lro": "true", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_memory_channel": "4", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_pmd": "", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_port_id": "0", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dump_on_send": "false", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_initial_backoff": "0.200000", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_delay_max": "1.000000", 2024-09-22T03:04:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_delay_type": "", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_network_congestion": "0", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_socket_failures": "0", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_learn_addr_from_peer": "true", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_max_accept_failures": "4", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_max_backoff": "15.000000", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_mon_client_mode": "crc", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_mon_cluster_mode": "crc", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_mon_service_mode": "crc", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_osd_compress_min_size": "1024", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_osd_compress_mode": "none", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-22T03:04:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_pq_min_cost": "65536", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_public_type": "", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_service_mode": "crc", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_tcp_listen_backlog": "512", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_tcp_nodelay": "true", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_tcp_rcvbuf": "0", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_type": "async+posix", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "no_config_file": "false", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_completion_locks_per_session": "32", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_inflight_ops": "1024", 2024-09-22T03:04:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_tick_interval": "5.000000", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_timeout": "10.000000", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "objectstore_blackhole": "false", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "openssl_engine_opts": "", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_delay_time": "5.000000", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_hist_halflife": "1000", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_max_low_ops": "2", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_max_ops": "4", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-22T03:04:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_slop": "0.020000", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_asio_thread_count": "2", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_async_recovery_min_cost": "100", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backfill_scan_max": "512", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backfill_scan_min": "64", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backoff_on_degraded": "false", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backoff_on_peering": "false", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backoff_on_unfound": "true", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_beacon_report_interval": "300", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bench_duration": "30", 2024-09-22T03:04:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bench_max_block_size": "67108864", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_blkin_trace_all": "false", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_check_for_log_corruption": "false", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_class_update_on_start": "true", 2024-09-22T03:04:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_client_message_cap": "256", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_client_message_size_cap": "524288000", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_client_op_priority": "63", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_client_watch_timeout": "30", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_command_max_records": "256", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_compact_on_start": "false", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_crush_update_on_start": "true", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_crush_update_weight_set": "true", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-22T03:04:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_feed_pullee": "-1", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_misdirected_ops": "false", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_no_acting_change": "false", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_no_purge_strays": "false", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_op_order": "false", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-22T03:04:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_shutdown": "false", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_trim_objects": "false", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_verify_snaps": "false", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_keys": "1024", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_stride": "524288", 2024-09-22T03:04:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_default_notify_timeout": "30", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_delete_sleep": "0.000000", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_discard_disconnected_ops": "true", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_enable_op_tracker": "true", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_fast_info": "true", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_fast_shutdown": "true", 2024-09-22T03:04:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_function_tracing": "false", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_grace": "20", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_interval": "6", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_min_peers": "10", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_min_size": "2000", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_stale": "600", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_hit_set_max_size": "100000", 2024-09-22T03:04:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_hit_set_min_size": "1000", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_journal_size": "5120", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_kill_backfill_at": "0", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_map_cache_size": "50", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_map_dedup": "true", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_map_message_max": "40", 2024-09-22T03:04:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_map_share_max_epochs": "40", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_attr_name_len": "100", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_attr_size": "0", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_backfills": "1", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_markdown_count": "5", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_markdown_period": "600", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_object_name_len": "2048", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_object_namespace_len": "256", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_object_size": "134217728", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_pg_blocked_by": "16", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_pg_log_entries": "10000", 2024-09-22T03:04:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_pgls": "1024", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_push_cost": "8388608", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_push_objects": "10", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_scrubs": "3", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_trimming_pgs": "2", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_write_op_reply_len": "64", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_write_size": "90", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-22T03:04:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_profile": "balanced", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-22T03:04:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_base": "805306368", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_cache_min": "134217728", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_target": "4294967296", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_target_autotune": "false", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_min_pg_log_entries": "250", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_min_recovery_priority": "0", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mon_report_interval": "5", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-22T03:04:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_num_cache_shards": "32", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_num_op_tracker_shard": "32", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_numa_auto_affinity": "true", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_numa_node": "-1", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_numa_prefer_iface": "true", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_objecter_finishers": "1", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_objectstore": "bluestore", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_objectstore_fuse": "false", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_objectstore_tracing": "false", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_complaint_time": "30.000000", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_history_duration": "600", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_history_size": "20", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_history_slow_op_size": "20", 2024-09-22T03:04:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_log_threshold": "5", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_shards": "0", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_shards_hdd": "5", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_shards_ssd": "8", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_pq_min_cost": "65536", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_queue_cut_off": "high", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_thread_timeout": "15", 2024-09-22T03:04:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_open_classes_on_start": "true", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_os_flags": "0", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_peering_op_priority": "255", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_delete_cost": "1048576", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_delete_priority": "5", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_log_trim_max": "10000", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_log_trim_min": "100", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-22T03:04:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_crimson": "true", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-22T03:04:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flags": "0", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_min_size": "2", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_pg_num": "32", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_pgp_num": "0", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_read_ratio": "70", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_size": "3", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_type": "replicated", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_push_per_object_cost": "1000", 2024-09-22T03:04:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recover_clone_overlap": "true", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_cost": "20971520", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_active": "0", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_single_start": "1", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_op_priority": "3", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_priority": "5", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-22T03:04:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_sleep": "0.000000", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_repair_during_recovery": "false", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_requested_scrub_priority": "120", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_auto_repair": "false", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_begin_hour": "0", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_begin_week_day": "0", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_chunk_max": "25", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_chunk_min": "5", 2024-09-22T03:04:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_cost": "52428800", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_during_recovery": "false", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_end_hour": "0", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_end_week_day": "0", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_event_cost": "4096", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_invalid_stats": "true", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_max_preemptions": "5", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_priority": "5", 2024-09-22T03:04:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_sleep": "0.000000", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_skip_data_digest": "false", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_smart_report_timeout": "5", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_cost": "1048576", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_priority": "5", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-22T03:04:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_target_transaction_size": "30", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tracing": "false", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_use_stale_snap": "false", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-22T03:04:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osdc_blkin_trace_all": "false", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_kill_at": "0", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_max_join_drift": "10", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_min": "500", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_min_wait": "0.050000", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_propose_interval": "1.000000", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_service_trim_max": "500", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_service_trim_min": "10", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_stash_full_interval": "25", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_trim_max": "500", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_trim_min": "250", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "perf": "true", 2024-09-22T03:04:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "-", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrv": "", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "public_bind_addr": "-", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "public_network": "", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "public_network_interface": "", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "qat_compressor_busy_polling": "false", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "qat_compressor_enabled": "false", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "qat_compressor_session_max_number": "256", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "rados_mon_op_timeout": "0", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "rados_osd_op_timeout": "0", 2024-09-22T03:04:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "rados_tracing": "false", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_atime_update_interval": "60", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_balance_parent_reads": "false", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_balance_snap_reads": "false", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_blkin_trace_all": "false", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache": "true", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_policy": "writearound", 2024-09-22T03:04:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_size": "33554432", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_clone_copy_on_read": "false", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_compression_hint": "none", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_concurrent_management_ops": "10", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_clone_format": "auto", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_data_pool": "", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_features": "61", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_format": "2", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_map_options": "", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_order": "22", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_pool": "rbd", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-22T03:04:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_stripe_count": "0", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_stripe_unit": "0", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_enable_alloc_hint": "true", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_io_scheduler": "simple", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-22T03:04:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_order": "24", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_pool": "", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_splay_width": "4", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_localize_parent_reads": "false", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_localize_snap_reads": "false", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-22T03:04:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-22T03:04:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mtime_update_interval": "60", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_non_blocking_aio": "true", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_op_thread_timeout": "60", 2024-09-22T03:04:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_op_threads": "1", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_parent_cache_enabled": "false", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_plugins": "", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_bps_burst": "0", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_bps_limit": "0", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_exclude_ops": "0", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_iops_burst": "0", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_iops_limit": "0", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-22T03:04:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-22T03:04:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_read_from_replica_policy": "default", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_skip_partial_discard": "true", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_tracing": "false", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_validate_names": "true", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_validate_pool": "true", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "restapi_base_url": "", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "restapi_log_level": "", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-22T03:04:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_acl_grants_max_num": "100", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_admin_entry": "admin", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_backend_store": "rados", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_barbican_url": "", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_beast_enable_async": "true", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_counters_cache": "false", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-22T03:04:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_cache_enabled": "true", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_cache_expiry_interval": "900", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_cache_lru_size": "25000", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_config_store": "rados", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_content_length_compat": "false", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_copy_obj_progress": "true", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_cors_rules_max_num": "100", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_cross_domain_policy": "", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_addr": "", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-22T03:04:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_password": "", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_username": "", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_require_ssl": "true", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-22T03:04:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-22T03:04:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-22T03:04:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-22T03:04:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-22T03:04:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-22T03:04:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-22T03:04:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-22T03:04:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_addr": "", 2024-09-22T03:04:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_auth": "token", 2024-09-22T03:04:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_namespace": "", 2024-09-22T03:04:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_prefix": "", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_token_file": "", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_curl_buffersize": "524288", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_curl_low_speed_time": "300", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-22T03:04:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d4n_port": "6379", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_log_changes_size": "1000", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_log_num_shards": "128", 2024-09-22T03:04:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_log_window": "30", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-22T03:04:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-22T03:04:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dns_name": "", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dns_s3website_name": "", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dynamic_resharding": "true", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_gc_threads": "true", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_lc_threads": "true", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_ops_log": "false", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_quota_threads": "true", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_static_website": "false", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_usage_log": "false", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enforce_swift_acls": "true", 2024-09-22T03:04:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_exit_timeout_secs": "120", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_expose_bucket": "false", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_extended_http_attrs": "", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_filter": "none", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_frontends": "beast port=7480", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_deferred": "50", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_objs": "32", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-22T03:04:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_processor_period": "3600", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_init_timeout": "300", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_kafka_connection_idle": "300", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-22T03:04:25.684 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_domain": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_password": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_password_path": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_project": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_tenant": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_token": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_token_path": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_user": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_api_version": "2", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_barbican_domain": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_barbican_password": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_barbican_project": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-22T03:04:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_barbican_user": "", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_url": "", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_debug_interval": "-1", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_lock_max_time": "90", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_max_objs": "32", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_max_rules": "1000", 2024-09-22T03:04:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_max_worker": "3", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_thread_delay": "0", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_dnattr": "uid", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_searchfilter": "", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_uri": "", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_log_http_headers": "", 2024-09-22T03:04:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_log_object_name_utc": "false", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_attr_name_len": "0", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_attr_size": "0", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_chunk_size": "4194304", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_listing_results": "1000", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_notify_retries": "10", 2024-09-22T03:04:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_put_param_size": "1048576", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_put_size": "5368709120", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_slo_entries": "1000", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_md_log_max_shards": "64", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_mp_lock_max_time": "600", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-22T03:04:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_max_gc": "300", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_num_async_rados_threads": "32", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_num_control_oids": "8", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_numa_node": "-1", 2024-09-22T03:04:25.690 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_objexp_chunk_size": "100", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_objexp_gc_interval": "600", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_op_thread_timeout": "600", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_op_tracing": "false", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_opa_token": "", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_opa_url": "", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_opa_verify_ssl": "true", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-22T03:04:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ops_log_rados": "false", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ops_log_socket_path": "", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_period_push_interval": "2.000000", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_cache_lanes": "3", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-22T03:04:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_cache_partitions": "3", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_print_continue": "true", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_rados_tracing": "false", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_realm": "", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_realm_id": "", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_region": "", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-22T03:04:25.693 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_request_uri": "", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_reshard_batch_size": "64", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_reshard_max_aio": "128", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_reshard_num_logs": "16", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_reshard_thread_interval": "600", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_resolve_cname": "false", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_run_sync_thread": "true", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-22T03:04:25.694 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_scheduler_type": "throttler", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_script_uri": "", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_service_provider_name": "", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_client_id": "", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_client_secret": "", 2024-09-22T03:04:25.695 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_entry": "sts", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_key": "sts", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_min_session_duration": "900", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_token_introspection_url": "", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_account_in_url": "false", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_auth_entry": "auth", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_auth_url": "", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_custom_header": "", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_need_stats": "true", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_tenant_name": "", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_token_expiration": "86400", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_url": "", 2024-09-22T03:04:25.696 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_url_prefix": "swift", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_lease_period": "120", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_thread_pool_size": "512", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-22T03:04:25.697 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_comment": "", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_createby": "", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_encoding": "", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_flag": "false", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_origin": "", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_tracker": "", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_trust_forwarded_https": "false", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-22T03:04:25.698 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_usage_max_shards": "32", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_usage_max_user_shards": "1", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_use_opa_authz": "false", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_counters_cache": "false", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_max_buckets": "1000", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_policies_max_num": "100", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_unique_email": "true", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_verify_ssl": "true", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-22T03:04:25.699 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zone": "", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zone_id": "", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zonegroup": "", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zonegroup_id": "", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rgwlc_auto_session_clear": "true", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_block_size": "4096", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_size": "536870912", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-22T03:04:25.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_index_type": "binary_search", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_partition_filters": "false", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_perf": "false", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-22T03:04:25.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "run_dir": "/var/run/ceph", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_block_create": "true", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_cache_lru_size": "67108864", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_default_max_object_size": "16777216", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_device_size": "53687091200", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_full_integrity_check": "false", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_journal_batch_capacity": "16", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-22T03:04:25.702 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_main_device_type": "SSD", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_segment_size": "67108864", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "set_keepcaps": "false", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "setgroup": "", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "setuser": "", 2024-09-22T03:04:25.703 INFO:teuthology.orchestra.run.smithi134.stdout: "setuser_match_path": "", 2024-09-22T03:04:25.704 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-22T03:04:25.704 INFO:teuthology.orchestra.run.smithi134.stdout: "thp": "false", 2024-09-22T03:04:25.704 INFO:teuthology.orchestra.run.smithi134.stdout: "threadpool_default_timeout": "60", 2024-09-22T03:04:25.704 INFO:teuthology.orchestra.run.smithi134.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-22T03:04:25.704 INFO:teuthology.orchestra.run.smithi134.stdout: "throttler_perf_counter": "true" 2024-09-22T03:04:25.704 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-22T03:04:25.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-22T03:04:25.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:25.805+0000 7f1511d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:25.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:25.809+0000 7f1511d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:25.824 INFO:teuthology.orchestra.run.smithi134.stdout:{} 2024-09-22T03:04:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T03:04:25.834 DEBUG:teuthology.orchestra.run.smithi134:> type ceph-objectstore-tool 2024-09-22T03:04:25.849 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-22T03:04:25.849 DEBUG:teuthology.orchestra.run.smithi139:> type ceph-objectstore-tool 2024-09-22T03:04:25.868 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-22T03:04:25.868 INFO:teuthology.run_tasks:Running task full_sequential... 2024-09-22T03:04:28.035 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:04:28.037 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:04:28.037 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-22T03:04:28.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-22T03:04:28.037 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-22T03:04:28.038 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:28.038 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:28.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:28.038 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-22T03:04:28.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:28.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:28.157+0000 7fa498917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:28.157+0000 7f1cfcb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:28.162+0000 7fa498917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:28.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:28.164+0000 7f1cfcb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:28.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:28.157+0000 7efdadece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:28.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:28.169+0000 7efdadece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:28.360 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:04:28.372 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-22T03:04:26.691919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108020,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379340,"statfs":{"total":386547056640,"available":386436444160,"internally_reserved":0,"allocated":671744,"data_stored":1894113,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.963517"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.744534+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:21.744534+0000","last_peered":"2024-09-22T03:04:21.744534+0000","last_clean":"2024-09-22T03:04:21.744534+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:21.744534+0000","last_undegraded":"2024-09-22T03:04:21.744534+0000","last_fullsized":"2024-09-22T03:04:21.744534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.745008+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:21.745008+0000","last_peered":"2024-09-22T03:04:21.745008+0000","last_clean":"2024-09-22T03:04:21.745008+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:21.745008+0000","last_undegraded":"2024-09-22T03:04:21.745008+0000","last_fullsized":"2024-09-22T03:04:21.745008+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743429+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:21.743429+0000","last_peered":"2024-09-22T03:04:21.743429+0000","last_clean":"2024-09-22T03:04:21.743429+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:21.743429+0000","last_undegraded":"2024-09-22T03:04:21.743429+0000","last_fullsized":"2024-09-22T03:04:21.743429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.741825+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:21.741825+0000","last_peered":"2024-09-22T03:04:21.741825+0000","last_clean":"2024-09-22T03:04:21.741825+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:21.741825+0000","last_undegraded":"2024-09-22T03:04:21.741825+0000","last_fullsized":"2024-09-22T03:04:21.741825+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743144+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:21.743144+0000","last_peered":"2024-09-22T03:04:21.743144+0000","last_clean":"2024-09-22T03:04:21.743144+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:21.743144+0000","last_undegraded":"2024-09-22T03:04:21.743144+0000","last_fullsized":"2024-09-22T03:04:21.743144+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743241+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:21.743241+0000","last_peered":"2024-09-22T03:04:21.743241+0000","last_clean":"2024-09-22T03:04:21.743241+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:21.743241+0000","last_undegraded":"2024-09-22T03:04:21.743241+0000","last_fullsized":"2024-09-22T03:04:21.743241+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"13'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.743308+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:21.743308+0000","last_peered":"2024-09-22T03:04:21.743308+0000","last_clean":"2024-09-22T03:04:21.743308+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:21.743308+0000","last_undegraded":"2024-09-22T03:04:21.743308+0000","last_fullsized":"2024-09-22T03:04:21.743308+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.740600+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:21.740600+0000","last_peered":"2024-09-22T03:04:21.740600+0000","last_clean":"2024-09-22T03:04:21.740600+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:21.740600+0000","last_undegraded":"2024-09-22T03:04:21.740600+0000","last_fullsized":"2024-09-22T03:04:21.740600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.740684+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:21.740684+0000","last_peered":"2024-09-22T03:04:21.740684+0000","last_clean":"2024-09-22T03:04:21.740684+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:21.740684+0000","last_undegraded":"2024-09-22T03:04:21.740684+0000","last_fullsized":"2024-09-22T03:04:21.740684+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":30757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":180224,"data_stored":621106,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:28.857 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_0' created 2024-09-22T03:04:28.874 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-22T03:04:28.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:28.981+0000 7fb7f9a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:28.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:28.993+0000 7fb7f9a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-22T03:04:30.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:30.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:30.351+0000 7fcffd397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:30.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:30.355+0000 7fcffd397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:30.877 DEBUG:teuthology.orchestra.run.smithi134:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-09-22T03:04:30.880 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:04:30.880 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:04:30.935 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:hints = 1 2024-09-22T03:04:30.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:04:30.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object prefix: benchmark_data_smithi134_29890 2024-09-22T03:04:30.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:04:30.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:04:31.935 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 1 16 409 393 3.07015 3.07031 0.0485531 0.0397816 2024-09-22T03:04:32.423 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:32.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:32.549+0000 7f9d66797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:32.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:32.554+0000 7f9d66797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:32.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 2 16 805 789 3.08183 3.09375 0.0575123 0.0398369 2024-09-22T03:04:33.373 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:33.373 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:04:33.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:33.504+0000 7f9aa4d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:33.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:33.513+0000 7f9aa4d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:33.868 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:04:33.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:04:33.935 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 3 16 1133 1117 2.90866 2.5625 0.0773095 0.0424883 2024-09-22T03:04:34.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:34.030+0000 7fcb4274e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:34.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:34.041+0000 7fcb4274e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:34.742 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:34.873 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:04:34.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:34.873+0000 7f73e7717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:34.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:34.884+0000 7f73e7717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:34.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:04:34.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 4 16 1505 1489 2.908 2.90625 0.0418562 0.0425971 2024-09-22T03:04:35.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:35.033+0000 7efca602c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:35.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:35.045+0000 7efca602c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:35.886 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:04:35.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:04:35.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 5 16 1891 1875 2.92948 3.01562 0.0542355 0.0424875 2024-09-22T03:04:36.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:36.045+0000 7f51608b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:36.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:36.057+0000 7f51608b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:36.893 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:04:36.911 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:04:36.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:36.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 6 16 2290 2274 2.96073 3.11719 0.0215385 0.042034 2024-09-22T03:04:37.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:37.055+0000 7f78f9ac3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:37.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:37.062+0000 7f78f9ac3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:37.080 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:37.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:37.223+0000 7fedb0ace640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:37.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:37.230+0000 7fedb0ace640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:37.366 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:37.367 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:04:37.386 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-22T03:04:36.895110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18285107,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2299,"num_write_kb":19176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2245,"ondisk_log_size":2245,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":145348,"kb_used_data":21380,"kb_used_omap":0,"kb_used_meta":123904,"kb_avail":377342012,"statfs":{"total":386547056640,"available":386398220288,"internally_reserved":0,"allocated":21893120,"data_stored":44091864,"data_compressed":2262039,"data_compressed_allocated":21188608,"data_compressed_original":43851776,"omap_allocated":0,"internal_metadata":126877696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15785984,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1927,"num_write_kb":15416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.201903"},"pg_stats":[{"pgid":"3.f","version":"19'111","reported_seq":130,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.506474+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:04:35.506474+0000","last_peered":"2024-09-22T03:04:35.506474+0000","last_clean":"2024-09-22T03:04:35.506474+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:04:35.506474+0000","last_undegraded":"2024-09-22T03:04:35.506474+0000","last_fullsized":"2024-09-22T03:04:35.506474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'159","reported_seq":181,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.672956+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:04:36.672956+0000","last_peered":"2024-09-22T03:04:36.672956+0000","last_clean":"2024-09-22T03:04:36.672956+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:04:36.672956+0000","last_undegraded":"2024-09-22T03:04:36.672956+0000","last_fullsized":"2024-09-22T03:04:36.672956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'135","reported_seq":157,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.690884+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:04:36.690884+0000","last_peered":"2024-09-22T03:04:36.690884+0000","last_clean":"2024-09-22T03:04:36.690884+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:04:36.690884+0000","last_undegraded":"2024-09-22T03:04:36.690884+0000","last_fullsized":"2024-09-22T03:04:36.690884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"19'135","reported_seq":154,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.655222+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:04:35.655222+0000","last_peered":"2024-09-22T03:04:35.655222+0000","last_clean":"2024-09-22T03:04:35.655222+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:04:35.655222+0000","last_undegraded":"2024-09-22T03:04:35.655222+0000","last_fullsized":"2024-09-22T03:04:35.655222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'119","reported_seq":141,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.658516+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:04:36.658516+0000","last_peered":"2024-09-22T03:04:36.658516+0000","last_clean":"2024-09-22T03:04:36.658516+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:04:36.658516+0000","last_undegraded":"2024-09-22T03:04:36.658516+0000","last_fullsized":"2024-09-22T03:04:36.658516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"19'135","reported_seq":154,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.632706+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:04:35.632706+0000","last_peered":"2024-09-22T03:04:35.632706+0000","last_clean":"2024-09-22T03:04:35.632706+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:04:35.632706+0000","last_undegraded":"2024-09-22T03:04:35.632706+0000","last_fullsized":"2024-09-22T03:04:35.632706+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"19'103","reported_seq":122,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.690670+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:04:35.690670+0000","last_peered":"2024-09-22T03:04:35.690670+0000","last_clean":"2024-09-22T03:04:35.690670+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:04:35.690670+0000","last_undegraded":"2024-09-22T03:04:35.690670+0000","last_fullsized":"2024-09-22T03:04:35.690670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'127","reported_seq":149,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.604294+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:04:36.604294+0000","last_peered":"2024-09-22T03:04:36.604294+0000","last_clean":"2024-09-22T03:04:36.604294+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:04:36.604294+0000","last_undegraded":"2024-09-22T03:04:36.604294+0000","last_fullsized":"2024-09-22T03:04:36.604294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.898399+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:35.898399+0000","last_peered":"2024-09-22T03:04:35.898399+0000","last_clean":"2024-09-22T03:04:35.898399+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:35.898399+0000","last_undegraded":"2024-09-22T03:04:35.898399+0000","last_fullsized":"2024-09-22T03:04:35.898399+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"20'131","reported_seq":153,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.710963+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:04:36.710963+0000","last_peered":"2024-09-22T03:04:36.710963+0000","last_clean":"2024-09-22T03:04:36.710963+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:04:36.710963+0000","last_undegraded":"2024-09-22T03:04:36.710963+0000","last_fullsized":"2024-09-22T03:04:36.710963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081344,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.896779+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:34.896779+0000","last_peered":"2024-09-22T03:04:34.896779+0000","last_clean":"2024-09-22T03:04:34.896779+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:34.896779+0000","last_undegraded":"2024-09-22T03:04:34.896779+0000","last_fullsized":"2024-09-22T03:04:34.896779+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'87","reported_seq":109,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.357844+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:04:36.357844+0000","last_peered":"2024-09-22T03:04:36.357844+0000","last_clean":"2024-09-22T03:04:36.357844+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:04:36.357844+0000","last_undegraded":"2024-09-22T03:04:36.357844+0000","last_fullsized":"2024-09-22T03:04:36.357844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":36,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.908544+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:35.908544+0000","last_peered":"2024-09-22T03:04:35.908544+0000","last_clean":"2024-09-22T03:04:35.908544+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:35.908544+0000","last_undegraded":"2024-09-22T03:04:35.908544+0000","last_fullsized":"2024-09-22T03:04:35.908544+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"20'159","reported_seq":181,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.630202+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:04:36.630202+0000","last_peered":"2024-09-22T03:04:36.630202+0000","last_clean":"2024-09-22T03:04:36.630202+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:04:36.630202+0000","last_undegraded":"2024-09-22T03:04:36.630202+0000","last_fullsized":"2024-09-22T03:04:36.630202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":35,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.902759+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:35.902759+0000","last_peered":"2024-09-22T03:04:35.902759+0000","last_clean":"2024-09-22T03:04:35.902759+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:35.902759+0000","last_undegraded":"2024-09-22T03:04:35.902759+0000","last_fullsized":"2024-09-22T03:04:35.902759+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.900292+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:34.900292+0000","last_peered":"2024-09-22T03:04:34.900292+0000","last_clean":"2024-09-22T03:04:34.900292+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:34.900292+0000","last_undegraded":"2024-09-22T03:04:34.900292+0000","last_fullsized":"2024-09-22T03:04:34.900292+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"19'112","reported_seq":133,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.903132+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:04:35.903132+0000","last_peered":"2024-09-22T03:04:35.903132+0000","last_clean":"2024-09-22T03:04:35.903132+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:04:35.903132+0000","last_undegraded":"2024-09-22T03:04:35.903132+0000","last_fullsized":"2024-09-22T03:04:35.903132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'143","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.540786+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:04:36.540786+0000","last_peered":"2024-09-22T03:04:36.540786+0000","last_clean":"2024-09-22T03:04:36.540786+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:04:36.540786+0000","last_undegraded":"2024-09-22T03:04:36.540786+0000","last_fullsized":"2024-09-22T03:04:36.540786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.906832+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:35.906832+0000","last_peered":"2024-09-22T03:04:35.906832+0000","last_clean":"2024-09-22T03:04:35.906832+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:35.906832+0000","last_undegraded":"2024-09-22T03:04:35.906832+0000","last_fullsized":"2024-09-22T03:04:35.906832+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'179","reported_seq":201,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.708675+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:04:36.708675+0000","last_peered":"2024-09-22T03:04:36.708675+0000","last_clean":"2024-09-22T03:04:36.708675+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:04:36.708675+0000","last_undegraded":"2024-09-22T03:04:36.708675+0000","last_fullsized":"2024-09-22T03:04:36.708675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1474560,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":1440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.913214+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:35.913214+0000","last_peered":"2024-09-22T03:04:35.913214+0000","last_clean":"2024-09-22T03:04:35.913214+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:35.913214+0000","last_undegraded":"2024-09-22T03:04:35.913214+0000","last_fullsized":"2024-09-22T03:04:35.913214+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'127","reported_seq":149,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.502403+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:04:36.502403+0000","last_peered":"2024-09-22T03:04:36.502403+0000","last_clean":"2024-09-22T03:04:36.502403+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:04:36.502403+0000","last_undegraded":"2024-09-22T03:04:36.502403+0000","last_fullsized":"2024-09-22T03:04:36.502403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.910248+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:35.910248+0000","last_peered":"2024-09-22T03:04:35.910248+0000","last_clean":"2024-09-22T03:04:35.910248+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:35.910248+0000","last_undegraded":"2024-09-22T03:04:35.910248+0000","last_fullsized":"2024-09-22T03:04:35.910248+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"20'183","reported_seq":205,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.529354+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:04:36.529354+0000","last_peered":"2024-09-22T03:04:36.529354+0000","last_clean":"2024-09-22T03:04:36.529354+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:04:36.529354+0000","last_undegraded":"2024-09-22T03:04:36.529354+0000","last_fullsized":"2024-09-22T03:04:36.529354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.910055+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:35.910055+0000","last_peered":"2024-09-22T03:04:35.910055+0000","last_clean":"2024-09-22T03:04:35.910055+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:35.910055+0000","last_undegraded":"2024-09-22T03:04:35.910055+0000","last_fullsized":"2024-09-22T03:04:35.910055+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":17694720,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2160,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26120192,"data_stored":52240384,"data_compressed":2694141,"data_compressed_allocated":26120192,"data_compressed_original":52240384,"omap_allocated":0,"internal_metadata":0},"log_size":2145,"ondisk_log_size":2145,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37392,"kb_used_data":6400,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94334448,"statfs":{"total":96636764160,"available":96598474752,"internally_reserved":0,"allocated":6553600,"data_stored":12827669,"data_compressed":658936,"data_compressed_allocated":6389760,"data_compressed_original":12779520,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35956,"kb_used_data":4964,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335884,"statfs":{"total":96636764160,"available":96599945216,"internally_reserved":0,"allocated":5083136,"data_stored":10354229,"data_compressed":530888,"data_compressed_allocated":4898816,"data_compressed_original":10289152,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37020,"kb_used_data":6028,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94334820,"statfs":{"total":96636764160,"available":96598855680,"internally_reserved":0,"allocated":6172672,"data_stored":12533301,"data_compressed":643254,"data_compressed_allocated":5988352,"data_compressed_original":12468224,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34980,"kb_used_data":3988,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94336860,"statfs":{"total":96636764160,"available":96600944640,"internally_reserved":0,"allocated":4083712,"data_stored":8376665,"data_compressed":428961,"data_compressed_allocated":3911680,"data_compressed_original":8314880,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4915200,"data_stored":9830400,"data_compressed":506866,"data_compressed_allocated":4915200,"data_compressed_original":9830400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7045120,"data_stored":14090240,"data_compressed":726658,"data_compressed_allocated":7045120,"data_compressed_original":14090240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":12451840,"data_compressed":642210,"data_compressed_allocated":6225920,"data_compressed_original":12451840,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7933952,"data_stored":15867904,"data_compressed":818407,"data_compressed_allocated":7933952,"data_compressed_original":15867904,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:37.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:37.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:37.510+0000 7fec23357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:37.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:37.519+0000 7fec23357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:37.754 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:04:37.773 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-22T03:04:36.895110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18285107,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2299,"num_write_kb":19176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2245,"ondisk_log_size":2245,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":145348,"kb_used_data":21380,"kb_used_omap":0,"kb_used_meta":123904,"kb_avail":377342012,"statfs":{"total":386547056640,"available":386398220288,"internally_reserved":0,"allocated":21893120,"data_stored":44091864,"data_compressed":2262039,"data_compressed_allocated":21188608,"data_compressed_original":43851776,"omap_allocated":0,"internal_metadata":126877696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15785984,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1927,"num_write_kb":15416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.201903"},"pg_stats":[{"pgid":"3.f","version":"19'111","reported_seq":130,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.506474+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:04:35.506474+0000","last_peered":"2024-09-22T03:04:35.506474+0000","last_clean":"2024-09-22T03:04:35.506474+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:04:35.506474+0000","last_undegraded":"2024-09-22T03:04:35.506474+0000","last_fullsized":"2024-09-22T03:04:35.506474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'159","reported_seq":181,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.672956+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:04:36.672956+0000","last_peered":"2024-09-22T03:04:36.672956+0000","last_clean":"2024-09-22T03:04:36.672956+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:04:36.672956+0000","last_undegraded":"2024-09-22T03:04:36.672956+0000","last_fullsized":"2024-09-22T03:04:36.672956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'135","reported_seq":157,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.690884+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:04:36.690884+0000","last_peered":"2024-09-22T03:04:36.690884+0000","last_clean":"2024-09-22T03:04:36.690884+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:04:36.690884+0000","last_undegraded":"2024-09-22T03:04:36.690884+0000","last_fullsized":"2024-09-22T03:04:36.690884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"19'135","reported_seq":154,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.655222+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:04:35.655222+0000","last_peered":"2024-09-22T03:04:35.655222+0000","last_clean":"2024-09-22T03:04:35.655222+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:04:35.655222+0000","last_undegraded":"2024-09-22T03:04:35.655222+0000","last_fullsized":"2024-09-22T03:04:35.655222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'119","reported_seq":141,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.658516+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:04:36.658516+0000","last_peered":"2024-09-22T03:04:36.658516+0000","last_clean":"2024-09-22T03:04:36.658516+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:04:36.658516+0000","last_undegraded":"2024-09-22T03:04:36.658516+0000","last_fullsized":"2024-09-22T03:04:36.658516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"19'135","reported_seq":154,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.632706+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:04:35.632706+0000","last_peered":"2024-09-22T03:04:35.632706+0000","last_clean":"2024-09-22T03:04:35.632706+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:04:35.632706+0000","last_undegraded":"2024-09-22T03:04:35.632706+0000","last_fullsized":"2024-09-22T03:04:35.632706+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"19'103","reported_seq":122,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.690670+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:04:35.690670+0000","last_peered":"2024-09-22T03:04:35.690670+0000","last_clean":"2024-09-22T03:04:35.690670+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:04:35.690670+0000","last_undegraded":"2024-09-22T03:04:35.690670+0000","last_fullsized":"2024-09-22T03:04:35.690670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'127","reported_seq":149,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.604294+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:04:36.604294+0000","last_peered":"2024-09-22T03:04:36.604294+0000","last_clean":"2024-09-22T03:04:36.604294+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:04:36.604294+0000","last_undegraded":"2024-09-22T03:04:36.604294+0000","last_fullsized":"2024-09-22T03:04:36.604294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.898399+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:35.898399+0000","last_peered":"2024-09-22T03:04:35.898399+0000","last_clean":"2024-09-22T03:04:35.898399+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:35.898399+0000","last_undegraded":"2024-09-22T03:04:35.898399+0000","last_fullsized":"2024-09-22T03:04:35.898399+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"20'131","reported_seq":153,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.710963+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:04:36.710963+0000","last_peered":"2024-09-22T03:04:36.710963+0000","last_clean":"2024-09-22T03:04:36.710963+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:04:36.710963+0000","last_undegraded":"2024-09-22T03:04:36.710963+0000","last_fullsized":"2024-09-22T03:04:36.710963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081344,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.896779+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:34.896779+0000","last_peered":"2024-09-22T03:04:34.896779+0000","last_clean":"2024-09-22T03:04:34.896779+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:34.896779+0000","last_undegraded":"2024-09-22T03:04:34.896779+0000","last_fullsized":"2024-09-22T03:04:34.896779+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'87","reported_seq":109,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.357844+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:04:36.357844+0000","last_peered":"2024-09-22T03:04:36.357844+0000","last_clean":"2024-09-22T03:04:36.357844+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:04:36.357844+0000","last_undegraded":"2024-09-22T03:04:36.357844+0000","last_fullsized":"2024-09-22T03:04:36.357844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":36,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.908544+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:35.908544+0000","last_peered":"2024-09-22T03:04:35.908544+0000","last_clean":"2024-09-22T03:04:35.908544+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:35.908544+0000","last_undegraded":"2024-09-22T03:04:35.908544+0000","last_fullsized":"2024-09-22T03:04:35.908544+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"20'159","reported_seq":181,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.630202+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:04:36.630202+0000","last_peered":"2024-09-22T03:04:36.630202+0000","last_clean":"2024-09-22T03:04:36.630202+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:04:36.630202+0000","last_undegraded":"2024-09-22T03:04:36.630202+0000","last_fullsized":"2024-09-22T03:04:36.630202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":35,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.902759+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:35.902759+0000","last_peered":"2024-09-22T03:04:35.902759+0000","last_clean":"2024-09-22T03:04:35.902759+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:35.902759+0000","last_undegraded":"2024-09-22T03:04:35.902759+0000","last_fullsized":"2024-09-22T03:04:35.902759+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.900292+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:34.900292+0000","last_peered":"2024-09-22T03:04:34.900292+0000","last_clean":"2024-09-22T03:04:34.900292+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:34.900292+0000","last_undegraded":"2024-09-22T03:04:34.900292+0000","last_fullsized":"2024-09-22T03:04:34.900292+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"19'112","reported_seq":133,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.903132+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:04:35.903132+0000","last_peered":"2024-09-22T03:04:35.903132+0000","last_clean":"2024-09-22T03:04:35.903132+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:04:35.903132+0000","last_undegraded":"2024-09-22T03:04:35.903132+0000","last_fullsized":"2024-09-22T03:04:35.903132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'143","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.540786+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:04:36.540786+0000","last_peered":"2024-09-22T03:04:36.540786+0000","last_clean":"2024-09-22T03:04:36.540786+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:04:36.540786+0000","last_undegraded":"2024-09-22T03:04:36.540786+0000","last_fullsized":"2024-09-22T03:04:36.540786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.906832+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:35.906832+0000","last_peered":"2024-09-22T03:04:35.906832+0000","last_clean":"2024-09-22T03:04:35.906832+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:35.906832+0000","last_undegraded":"2024-09-22T03:04:35.906832+0000","last_fullsized":"2024-09-22T03:04:35.906832+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'179","reported_seq":201,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.708675+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:04:36.708675+0000","last_peered":"2024-09-22T03:04:36.708675+0000","last_clean":"2024-09-22T03:04:36.708675+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:04:36.708675+0000","last_undegraded":"2024-09-22T03:04:36.708675+0000","last_fullsized":"2024-09-22T03:04:36.708675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1474560,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":1440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.913214+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:35.913214+0000","last_peered":"2024-09-22T03:04:35.913214+0000","last_clean":"2024-09-22T03:04:35.913214+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:35.913214+0000","last_undegraded":"2024-09-22T03:04:35.913214+0000","last_fullsized":"2024-09-22T03:04:35.913214+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'127","reported_seq":149,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.502403+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:04:36.502403+0000","last_peered":"2024-09-22T03:04:36.502403+0000","last_clean":"2024-09-22T03:04:36.502403+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:04:36.502403+0000","last_undegraded":"2024-09-22T03:04:36.502403+0000","last_fullsized":"2024-09-22T03:04:36.502403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.910248+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:35.910248+0000","last_peered":"2024-09-22T03:04:35.910248+0000","last_clean":"2024-09-22T03:04:35.910248+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:35.910248+0000","last_undegraded":"2024-09-22T03:04:35.910248+0000","last_fullsized":"2024-09-22T03:04:35.910248+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"20'183","reported_seq":205,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.529354+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:04:36.529354+0000","last_peered":"2024-09-22T03:04:36.529354+0000","last_clean":"2024-09-22T03:04:36.529354+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:04:36.529354+0000","last_undegraded":"2024-09-22T03:04:36.529354+0000","last_fullsized":"2024-09-22T03:04:36.529354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.910055+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:35.910055+0000","last_peered":"2024-09-22T03:04:35.910055+0000","last_clean":"2024-09-22T03:04:35.910055+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:35.910055+0000","last_undegraded":"2024-09-22T03:04:35.910055+0000","last_fullsized":"2024-09-22T03:04:35.910055+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":17694720,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2160,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26120192,"data_stored":52240384,"data_compressed":2694141,"data_compressed_allocated":26120192,"data_compressed_original":52240384,"omap_allocated":0,"internal_metadata":0},"log_size":2145,"ondisk_log_size":2145,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37392,"kb_used_data":6400,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94334448,"statfs":{"total":96636764160,"available":96598474752,"internally_reserved":0,"allocated":6553600,"data_stored":12827669,"data_compressed":658936,"data_compressed_allocated":6389760,"data_compressed_original":12779520,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35956,"kb_used_data":4964,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335884,"statfs":{"total":96636764160,"available":96599945216,"internally_reserved":0,"allocated":5083136,"data_stored":10354229,"data_compressed":530888,"data_compressed_allocated":4898816,"data_compressed_original":10289152,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37020,"kb_used_data":6028,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94334820,"statfs":{"total":96636764160,"available":96598855680,"internally_reserved":0,"allocated":6172672,"data_stored":12533301,"data_compressed":643254,"data_compressed_allocated":5988352,"data_compressed_original":12468224,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34980,"kb_used_data":3988,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94336860,"statfs":{"total":96636764160,"available":96600944640,"internally_reserved":0,"allocated":4083712,"data_stored":8376665,"data_compressed":428961,"data_compressed_allocated":3911680,"data_compressed_original":8314880,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4915200,"data_stored":9830400,"data_compressed":506866,"data_compressed_allocated":4915200,"data_compressed_original":9830400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7045120,"data_stored":14090240,"data_compressed":726658,"data_compressed_allocated":7045120,"data_compressed_original":14090240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":12451840,"data_compressed":642210,"data_compressed_allocated":6225920,"data_compressed_original":12451840,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7933952,"data_stored":15867904,"data_compressed":818407,"data_compressed_allocated":7933952,"data_compressed_original":15867904,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:37.774 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:04:37.774 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:37.774 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:37.911+0000 7f0119e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:37.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:37.920+0000 7f0119e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:37.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 7 16 2644 2628 2.93282 2.76562 0.0336388 0.0424525 2024-09-22T03:04:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:04:38.170 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-22T03:04:36.895110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18285107,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2299,"num_write_kb":19176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2245,"ondisk_log_size":2245,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":145348,"kb_used_data":21380,"kb_used_omap":0,"kb_used_meta":123904,"kb_avail":377342012,"statfs":{"total":386547056640,"available":386398220288,"internally_reserved":0,"allocated":21893120,"data_stored":44091864,"data_compressed":2262039,"data_compressed_allocated":21188608,"data_compressed_original":43851776,"omap_allocated":0,"internal_metadata":126877696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15785984,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1927,"num_write_kb":15416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.201903"},"pg_stats":[{"pgid":"3.f","version":"19'111","reported_seq":130,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.506474+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:04:35.506474+0000","last_peered":"2024-09-22T03:04:35.506474+0000","last_clean":"2024-09-22T03:04:35.506474+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:04:35.506474+0000","last_undegraded":"2024-09-22T03:04:35.506474+0000","last_fullsized":"2024-09-22T03:04:35.506474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'159","reported_seq":181,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.672956+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:04:36.672956+0000","last_peered":"2024-09-22T03:04:36.672956+0000","last_clean":"2024-09-22T03:04:36.672956+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:04:36.672956+0000","last_undegraded":"2024-09-22T03:04:36.672956+0000","last_fullsized":"2024-09-22T03:04:36.672956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'135","reported_seq":157,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.690884+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:04:36.690884+0000","last_peered":"2024-09-22T03:04:36.690884+0000","last_clean":"2024-09-22T03:04:36.690884+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:04:36.690884+0000","last_undegraded":"2024-09-22T03:04:36.690884+0000","last_fullsized":"2024-09-22T03:04:36.690884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"19'135","reported_seq":154,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.655222+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:04:35.655222+0000","last_peered":"2024-09-22T03:04:35.655222+0000","last_clean":"2024-09-22T03:04:35.655222+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:04:35.655222+0000","last_undegraded":"2024-09-22T03:04:35.655222+0000","last_fullsized":"2024-09-22T03:04:35.655222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'119","reported_seq":141,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.658516+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:04:36.658516+0000","last_peered":"2024-09-22T03:04:36.658516+0000","last_clean":"2024-09-22T03:04:36.658516+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:04:36.658516+0000","last_undegraded":"2024-09-22T03:04:36.658516+0000","last_fullsized":"2024-09-22T03:04:36.658516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"19'135","reported_seq":154,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.632706+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:04:35.632706+0000","last_peered":"2024-09-22T03:04:35.632706+0000","last_clean":"2024-09-22T03:04:35.632706+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:04:35.632706+0000","last_undegraded":"2024-09-22T03:04:35.632706+0000","last_fullsized":"2024-09-22T03:04:35.632706+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"19'103","reported_seq":122,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.690670+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:04:35.690670+0000","last_peered":"2024-09-22T03:04:35.690670+0000","last_clean":"2024-09-22T03:04:35.690670+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:04:35.690670+0000","last_undegraded":"2024-09-22T03:04:35.690670+0000","last_fullsized":"2024-09-22T03:04:35.690670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'127","reported_seq":149,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.604294+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:04:36.604294+0000","last_peered":"2024-09-22T03:04:36.604294+0000","last_clean":"2024-09-22T03:04:36.604294+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:04:36.604294+0000","last_undegraded":"2024-09-22T03:04:36.604294+0000","last_fullsized":"2024-09-22T03:04:36.604294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.898399+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:35.898399+0000","last_peered":"2024-09-22T03:04:35.898399+0000","last_clean":"2024-09-22T03:04:35.898399+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:35.898399+0000","last_undegraded":"2024-09-22T03:04:35.898399+0000","last_fullsized":"2024-09-22T03:04:35.898399+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"20'131","reported_seq":153,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.710963+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:04:36.710963+0000","last_peered":"2024-09-22T03:04:36.710963+0000","last_clean":"2024-09-22T03:04:36.710963+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:04:36.710963+0000","last_undegraded":"2024-09-22T03:04:36.710963+0000","last_fullsized":"2024-09-22T03:04:36.710963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081344,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.896779+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:34.896779+0000","last_peered":"2024-09-22T03:04:34.896779+0000","last_clean":"2024-09-22T03:04:34.896779+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:34.896779+0000","last_undegraded":"2024-09-22T03:04:34.896779+0000","last_fullsized":"2024-09-22T03:04:34.896779+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'87","reported_seq":109,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.357844+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:04:36.357844+0000","last_peered":"2024-09-22T03:04:36.357844+0000","last_clean":"2024-09-22T03:04:36.357844+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:04:36.357844+0000","last_undegraded":"2024-09-22T03:04:36.357844+0000","last_fullsized":"2024-09-22T03:04:36.357844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":36,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.908544+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:35.908544+0000","last_peered":"2024-09-22T03:04:35.908544+0000","last_clean":"2024-09-22T03:04:35.908544+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:35.908544+0000","last_undegraded":"2024-09-22T03:04:35.908544+0000","last_fullsized":"2024-09-22T03:04:35.908544+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"20'159","reported_seq":181,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.630202+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:04:36.630202+0000","last_peered":"2024-09-22T03:04:36.630202+0000","last_clean":"2024-09-22T03:04:36.630202+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:04:36.630202+0000","last_undegraded":"2024-09-22T03:04:36.630202+0000","last_fullsized":"2024-09-22T03:04:36.630202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":35,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.902759+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:35.902759+0000","last_peered":"2024-09-22T03:04:35.902759+0000","last_clean":"2024-09-22T03:04:35.902759+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:35.902759+0000","last_undegraded":"2024-09-22T03:04:35.902759+0000","last_fullsized":"2024-09-22T03:04:35.902759+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.900292+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:34.900292+0000","last_peered":"2024-09-22T03:04:34.900292+0000","last_clean":"2024-09-22T03:04:34.900292+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:34.900292+0000","last_undegraded":"2024-09-22T03:04:34.900292+0000","last_fullsized":"2024-09-22T03:04:34.900292+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"19'112","reported_seq":133,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.903132+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:04:35.903132+0000","last_peered":"2024-09-22T03:04:35.903132+0000","last_clean":"2024-09-22T03:04:35.903132+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:04:35.903132+0000","last_undegraded":"2024-09-22T03:04:35.903132+0000","last_fullsized":"2024-09-22T03:04:35.903132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'143","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.540786+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:04:36.540786+0000","last_peered":"2024-09-22T03:04:36.540786+0000","last_clean":"2024-09-22T03:04:36.540786+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:04:36.540786+0000","last_undegraded":"2024-09-22T03:04:36.540786+0000","last_fullsized":"2024-09-22T03:04:36.540786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.906832+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:35.906832+0000","last_peered":"2024-09-22T03:04:35.906832+0000","last_clean":"2024-09-22T03:04:35.906832+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:35.906832+0000","last_undegraded":"2024-09-22T03:04:35.906832+0000","last_fullsized":"2024-09-22T03:04:35.906832+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'179","reported_seq":201,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.708675+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:04:36.708675+0000","last_peered":"2024-09-22T03:04:36.708675+0000","last_clean":"2024-09-22T03:04:36.708675+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:04:36.708675+0000","last_undegraded":"2024-09-22T03:04:36.708675+0000","last_fullsized":"2024-09-22T03:04:36.708675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1474560,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":1440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.913214+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:35.913214+0000","last_peered":"2024-09-22T03:04:35.913214+0000","last_clean":"2024-09-22T03:04:35.913214+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:35.913214+0000","last_undegraded":"2024-09-22T03:04:35.913214+0000","last_fullsized":"2024-09-22T03:04:35.913214+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'127","reported_seq":149,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.502403+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:04:36.502403+0000","last_peered":"2024-09-22T03:04:36.502403+0000","last_clean":"2024-09-22T03:04:36.502403+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:04:36.502403+0000","last_undegraded":"2024-09-22T03:04:36.502403+0000","last_fullsized":"2024-09-22T03:04:36.502403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.910248+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:35.910248+0000","last_peered":"2024-09-22T03:04:35.910248+0000","last_clean":"2024-09-22T03:04:35.910248+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:35.910248+0000","last_undegraded":"2024-09-22T03:04:35.910248+0000","last_fullsized":"2024-09-22T03:04:35.910248+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"20'183","reported_seq":205,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.529354+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:04:36.529354+0000","last_peered":"2024-09-22T03:04:36.529354+0000","last_clean":"2024-09-22T03:04:36.529354+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:04:36.529354+0000","last_undegraded":"2024-09-22T03:04:36.529354+0000","last_fullsized":"2024-09-22T03:04:36.529354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.910055+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:35.910055+0000","last_peered":"2024-09-22T03:04:35.910055+0000","last_clean":"2024-09-22T03:04:35.910055+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:35.910055+0000","last_undegraded":"2024-09-22T03:04:35.910055+0000","last_fullsized":"2024-09-22T03:04:35.910055+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":17694720,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2160,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26120192,"data_stored":52240384,"data_compressed":2694141,"data_compressed_allocated":26120192,"data_compressed_original":52240384,"omap_allocated":0,"internal_metadata":0},"log_size":2145,"ondisk_log_size":2145,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37392,"kb_used_data":6400,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94334448,"statfs":{"total":96636764160,"available":96598474752,"internally_reserved":0,"allocated":6553600,"data_stored":12827669,"data_compressed":658936,"data_compressed_allocated":6389760,"data_compressed_original":12779520,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35956,"kb_used_data":4964,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335884,"statfs":{"total":96636764160,"available":96599945216,"internally_reserved":0,"allocated":5083136,"data_stored":10354229,"data_compressed":530888,"data_compressed_allocated":4898816,"data_compressed_original":10289152,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37020,"kb_used_data":6028,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94334820,"statfs":{"total":96636764160,"available":96598855680,"internally_reserved":0,"allocated":6172672,"data_stored":12533301,"data_compressed":643254,"data_compressed_allocated":5988352,"data_compressed_original":12468224,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34980,"kb_used_data":3988,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94336860,"statfs":{"total":96636764160,"available":96600944640,"internally_reserved":0,"allocated":4083712,"data_stored":8376665,"data_compressed":428961,"data_compressed_allocated":3911680,"data_compressed_original":8314880,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4915200,"data_stored":9830400,"data_compressed":506866,"data_compressed_allocated":4915200,"data_compressed_original":9830400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7045120,"data_stored":14090240,"data_compressed":726658,"data_compressed_allocated":7045120,"data_compressed_original":14090240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":12451840,"data_compressed":642210,"data_compressed_allocated":6225920,"data_compressed_original":12451840,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7933952,"data_stored":15867904,"data_compressed":818407,"data_compressed_allocated":7933952,"data_compressed_original":15867904,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:38.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 8 16 3048 3032 2.96072 3.15625 0.041274 0.0421208 2024-09-22T03:04:39.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:39.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:39.602+0000 7fea56d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:39.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:39.608+0000 7fea56d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:39.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 9 16 3431 3415 2.96419 2.99219 0.0593568 0.0421047 2024-09-22T03:04:40.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 10 16 3820 3804 2.97165 3.03906 0.0332583 0.041918 2024-09-22T03:04:41.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:41.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:41.874+0000 7f46182fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:41.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:41.880+0000 7f46182fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:41.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 11 16 4198 4182 2.96995 2.95312 0.0475645 0.0420228 2024-09-22T03:04:42.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 12 16 4547 4531 2.94965 2.72656 0.073621 0.0422169 2024-09-22T03:04:43.172 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:43.172 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:43.172 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:04:43.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:04:43.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:43.328+0000 7f4bf7c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:43.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:43.340+0000 7f4bf7c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:43.432 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:43.432 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:04:43.432 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:04:43.432 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:04:43.432 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:04:43.432 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:04:43.432 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:04:43.433 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:04:43.433 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:04:43.433 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:04:43.433 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:04:43.433 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:04:43.436 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:43.437 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:43.437 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:04:43.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:43.569+0000 7f44f1917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:43.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:43.581+0000 7f44f1917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:43.645 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:43.645 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:04:43.645 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:04:43.645 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:04:43.645 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:04:43.645 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:04:43.646 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:04:43.646 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:04:43.646 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:04:43.646 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:04:43.646 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:04:43.646 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:04:43.648 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:43.649 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:43.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:04:43.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:43.770+0000 7f2151997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:43.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:43.784+0000 7f2151997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:43.820 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:43.820 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:04:43.820 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:04:43.820 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:04:43.820 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:04:43.821 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:04:43.821 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:04:43.821 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:04:43.821 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:04:43.821 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:04:43.821 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:04:43.821 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:04:43.823 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:43.824 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:43.824 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:04:43.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 13 16 4894 4878 2.93127 2.71094 0.0322661 0.042569 2024-09-22T03:04:43.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:43.948+0000 7f160b0b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:43.958+0000 7f160b0b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:43.983 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:43.984 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:43.984 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:04:43.985 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:04:43.985 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:04:43.985 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:04:43.985 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:04:43.985 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:04:43.985 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:04:43.985 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:04:43.985 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:04:43.985 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:04:43.985 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:04:43.989 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:43.989 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:44.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:44.120+0000 7fd3e5b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:44.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:44.126+0000 7fd3e5b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:44.936 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 14 16 5212 5196 2.89934 2.48438 0.0285543 0.0430433 2024-09-22T03:04:45.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 15 16 5553 5537 2.88364 2.66406 0.0825016 0.0431972 2024-09-22T03:04:46.303 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:46.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:46.447+0000 7f9e59a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:46.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:46.454+0000 7f9e59a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:46.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 16 16 5907 5891 2.87625 2.76562 0.0306883 0.0434057 2024-09-22T03:04:47.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 17 16 6291 6275 2.88351 3 0.0333564 0.0432862 2024-09-22T03:04:48.642 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:48.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:48.767+0000 7f9f49223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:48.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:48.772+0000 7f9f49223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:48.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 18 16 6655 6639 2.88129 2.84375 0.037194 0.0433338 2024-09-22T03:04:48.990 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:48.990 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:48.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:49.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:49.144+0000 7f9d3242c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:49.154+0000 7f9d3242c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:49.386 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:04:49.403 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-22T03:04:48.695738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47407667,"num_objects":719,"num_object_clones":0,"num_object_copies":2157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5854,"num_write_kb":47616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5799,"ondisk_log_size":5799,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":197928,"kb_used_data":65640,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377289432,"statfs":{"total":386547056640,"available":386344378368,"internally_reserved":0,"allocated":67215360,"data_stored":134618345,"data_compressed":6934920,"data_compressed_allocated":66437120,"data_compressed_original":134348800,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29122560,"num_objects":444,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3555,"num_write_kb":28440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.800628"},"pg_stats":[{"pgid":"3.f","version":"21'303","reported_seq":328,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:45.560881+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:04:45.560881+0000","last_peered":"2024-09-22T03:04:45.560881+0000","last_clean":"2024-09-22T03:04:45.560881+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:04:45.560881+0000","last_undegraded":"2024-09-22T03:04:45.560881+0000","last_fullsized":"2024-09-22T03:04:45.560881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'327","reported_seq":352,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.617124+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:04:46.617124+0000","last_peered":"2024-09-22T03:04:46.617124+0000","last_clean":"2024-09-22T03:04:46.617124+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:04:46.617124+0000","last_undegraded":"2024-09-22T03:04:46.617124+0000","last_fullsized":"2024-09-22T03:04:46.617124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'327","reported_seq":352,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.454516+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:04:46.454516+0000","last_peered":"2024-09-22T03:04:46.454516+0000","last_clean":"2024-09-22T03:04:46.454516+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:04:46.454516+0000","last_undegraded":"2024-09-22T03:04:46.454516+0000","last_fullsized":"2024-09-22T03:04:46.454516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'327","reported_seq":352,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:45.608727+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:04:45.608727+0000","last_peered":"2024-09-22T03:04:45.608727+0000","last_clean":"2024-09-22T03:04:45.608727+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:04:45.608727+0000","last_undegraded":"2024-09-22T03:04:45.608727+0000","last_fullsized":"2024-09-22T03:04:45.608727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'319","reported_seq":344,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.333570+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:04:46.333570+0000","last_peered":"2024-09-22T03:04:46.333570+0000","last_clean":"2024-09-22T03:04:46.333570+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:04:46.333570+0000","last_undegraded":"2024-09-22T03:04:46.333570+0000","last_fullsized":"2024-09-22T03:04:46.333570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'335","reported_seq":360,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:45.525467+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:04:45.525467+0000","last_peered":"2024-09-22T03:04:45.525467+0000","last_clean":"2024-09-22T03:04:45.525467+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:04:45.525467+0000","last_undegraded":"2024-09-22T03:04:45.525467+0000","last_fullsized":"2024-09-22T03:04:45.525467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'287","reported_seq":312,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:45.307484+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:04:45.307484+0000","last_peered":"2024-09-22T03:04:45.307484+0000","last_clean":"2024-09-22T03:04:45.307484+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:04:45.307484+0000","last_undegraded":"2024-09-22T03:04:45.307484+0000","last_fullsized":"2024-09-22T03:04:45.307484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'410","reported_seq":435,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.701446+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:04:46.701446+0000","last_peered":"2024-09-22T03:04:46.701446+0000","last_clean":"2024-09-22T03:04:46.701446+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:04:46.701446+0000","last_undegraded":"2024-09-22T03:04:46.701446+0000","last_fullsized":"2024-09-22T03:04:46.701446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3366912,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":3288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'463","reported_seq":488,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.506189+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:04:46.506189+0000","last_peered":"2024-09-22T03:04:46.506189+0000","last_clean":"2024-09-22T03:04:46.506189+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:04:46.506189+0000","last_undegraded":"2024-09-22T03:04:46.506189+0000","last_fullsized":"2024-09-22T03:04:46.506189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'287","reported_seq":312,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:45.961153+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:04:45.961153+0000","last_peered":"2024-09-22T03:04:45.961153+0000","last_clean":"2024-09-22T03:04:45.961153+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:04:45.961153+0000","last_undegraded":"2024-09-22T03:04:45.961153+0000","last_fullsized":"2024-09-22T03:04:45.961153+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'399","reported_seq":424,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:45.929414+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:04:45.929414+0000","last_peered":"2024-09-22T03:04:45.929414+0000","last_clean":"2024-09-22T03:04:45.929414+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:04:45.929414+0000","last_undegraded":"2024-09-22T03:04:45.929414+0000","last_fullsized":"2024-09-22T03:04:45.929414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'359","reported_seq":384,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.709569+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:04:46.709569+0000","last_peered":"2024-09-22T03:04:46.709569+0000","last_clean":"2024-09-22T03:04:46.709569+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:04:46.709569+0000","last_undegraded":"2024-09-22T03:04:46.709569+0000","last_fullsized":"2024-09-22T03:04:46.709569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'383","reported_seq":408,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.703367+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:04:46.703367+0000","last_peered":"2024-09-22T03:04:46.703367+0000","last_clean":"2024-09-22T03:04:46.703367+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:04:46.703367+0000","last_undegraded":"2024-09-22T03:04:46.703367+0000","last_fullsized":"2024-09-22T03:04:46.703367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'391","reported_seq":416,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.671687+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:04:46.671687+0000","last_peered":"2024-09-22T03:04:46.671687+0000","last_clean":"2024-09-22T03:04:46.671687+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:04:46.671687+0000","last_undegraded":"2024-09-22T03:04:46.671687+0000","last_fullsized":"2024-09-22T03:04:46.671687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'367","reported_seq":392,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:45.686522+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:04:45.686522+0000","last_peered":"2024-09-22T03:04:45.686522+0000","last_clean":"2024-09-22T03:04:45.686522+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:04:45.686522+0000","last_undegraded":"2024-09-22T03:04:45.686522+0000","last_fullsized":"2024-09-22T03:04:45.686522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'415","reported_seq":440,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.645562+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:04:46.645562+0000","last_peered":"2024-09-22T03:04:46.645562+0000","last_clean":"2024-09-22T03:04:46.645562+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:04:46.645562+0000","last_undegraded":"2024-09-22T03:04:46.645562+0000","last_fullsized":"2024-09-22T03:04:46.645562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":46817280,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5715,"num_write_kb":45720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":70524928,"data_stored":141049856,"data_compressed":7279884,"data_compressed_allocated":70524928,"data_compressed_original":141049856,"omap_allocated":0,"internal_metadata":0},"log_size":5699,"ondisk_log_size":5699,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46464,"kb_used_data":19632,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94325376,"statfs":{"total":96636764160,"available":96589185024,"internally_reserved":0,"allocated":20103168,"data_stored":39900583,"data_compressed":2056528,"data_compressed_allocated":19922944,"data_compressed_original":39845888,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54428,"kb_used_data":15116,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317412,"statfs":{"total":96636764160,"available":96581029888,"internally_reserved":0,"allocated":15478784,"data_stored":31119303,"data_compressed":1602770,"data_compressed_allocated":15278080,"data_compressed_original":31047680,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43956,"kb_used_data":17124,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94327884,"statfs":{"total":96636764160,"available":96591753216,"internally_reserved":0,"allocated":17534976,"data_stored":35231687,"data_compressed":1814964,"data_compressed_allocated":17334272,"data_compressed_original":35160064,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53080,"kb_used_data":13768,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94318760,"statfs":{"total":96636764160,"available":96582410240,"internally_reserved":0,"allocated":14098432,"data_stored":28366772,"data_compressed":1460658,"data_compressed_allocated":13901824,"data_compressed_original":28295168,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14934016,"data_stored":29868032,"data_compressed":1541524,"data_compressed_allocated":14934016,"data_compressed_original":29868032,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18378752,"data_stored":36757504,"data_compressed":1897099,"data_compressed_allocated":18378752,"data_compressed_original":36757504,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16101376,"data_stored":32202752,"data_compressed":1662063,"data_compressed_allocated":16101376,"data_compressed_original":32202752,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21110784,"data_stored":42221568,"data_compressed":2179198,"data_compressed_allocated":21110784,"data_compressed_original":42221568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:49.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 19 16 7005 6989 2.87355 2.73438 0.0184225 0.043426 2024-09-22T03:04:50.925 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:50.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:04:50.936643+0000 min lat: 0.00903024 max lat: 0.182354 avg lat: 0.0433438 2024-09-22T03:04:50.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:04:50.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 20 16 7392 7376 2.88103 3.02344 0.0367803 0.0433438 2024-09-22T03:04:51.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:51.056+0000 7ffa5a06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:51.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:51.062+0000 7ffa5a06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:51.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 21 16 7721 7705 2.86622 2.57031 0.0384747 0.0435484 2024-09-22T03:04:52.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 22 16 8063 8047 2.85738 2.67188 0.0355076 0.0436844 2024-09-22T03:04:53.219 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:53.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:53.337+0000 7f415106c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:53.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:53.343+0000 7f415106c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:53.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 23 16 8413 8397 2.85202 2.73438 0.0300271 0.0437848 2024-09-22T03:04:54.405 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:54.405 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:54.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:54.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:54.536+0000 7f6e30c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:54.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:54.546+0000 7f6e30c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:04:54.801 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:04:54.816 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-22T03:04:54.696678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":62661171,"num_objects":952,"num_object_clones":0,"num_object_copies":2856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7716,"num_write_kb":62512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7661,"ondisk_log_size":7661,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":211212,"kb_used_data":87244,"kb_used_omap":0,"kb_used_meta":123904,"kb_avail":377276148,"statfs":{"total":386547056640,"available":386330775552,"internally_reserved":0,"allocated":89337856,"data_stored":178863337,"data_compressed":9219543,"data_compressed_allocated":88559616,"data_compressed_original":178593792,"omap_allocated":0,"internal_metadata":126877696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29048832,"num_objects":443,"num_object_clones":0,"num_object_copies":1329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3546,"num_write_kb":28368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001873"},"pg_stats":[{"pgid":"3.f","version":"21'399","reported_seq":424,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:50.553860+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:04:50.553860+0000","last_peered":"2024-09-22T03:04:50.553860+0000","last_clean":"2024-09-22T03:04:50.553860+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:04:50.553860+0000","last_undegraded":"2024-09-22T03:04:50.553860+0000","last_fullsized":"2024-09-22T03:04:50.553860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'463","reported_seq":488,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.578595+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:04:51.578595+0000","last_peered":"2024-09-22T03:04:51.578595+0000","last_clean":"2024-09-22T03:04:51.578595+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:04:51.578595+0000","last_undegraded":"2024-09-22T03:04:51.578595+0000","last_fullsized":"2024-09-22T03:04:51.578595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'519","reported_seq":544,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.646789+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:04:51.646789+0000","last_peered":"2024-09-22T03:04:51.646789+0000","last_clean":"2024-09-22T03:04:51.646789+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:04:51.646789+0000","last_undegraded":"2024-09-22T03:04:51.646789+0000","last_fullsized":"2024-09-22T03:04:51.646789+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'471","reported_seq":496,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:50.700286+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:04:50.700286+0000","last_peered":"2024-09-22T03:04:50.700286+0000","last_clean":"2024-09-22T03:04:50.700286+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:04:50.700286+0000","last_undegraded":"2024-09-22T03:04:50.700286+0000","last_fullsized":"2024-09-22T03:04:50.700286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'399","reported_seq":424,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:50.933739+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:04:50.933739+0000","last_peered":"2024-09-22T03:04:50.933739+0000","last_clean":"2024-09-22T03:04:50.933739+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:04:50.933739+0000","last_undegraded":"2024-09-22T03:04:50.933739+0000","last_fullsized":"2024-09-22T03:04:50.933739+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'431","reported_seq":456,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:50.316334+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:04:50.316334+0000","last_peered":"2024-09-22T03:04:50.316334+0000","last_clean":"2024-09-22T03:04:50.316334+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:04:50.316334+0000","last_undegraded":"2024-09-22T03:04:50.316334+0000","last_fullsized":"2024-09-22T03:04:50.316334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'423","reported_seq":448,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:50.218741+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:04:50.218741+0000","last_peered":"2024-09-22T03:04:50.218741+0000","last_clean":"2024-09-22T03:04:50.218741+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:04:50.218741+0000","last_undegraded":"2024-09-22T03:04:50.218741+0000","last_fullsized":"2024-09-22T03:04:50.218741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'495","reported_seq":520,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.704804+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:04:51.704804+0000","last_peered":"2024-09-22T03:04:51.704804+0000","last_clean":"2024-09-22T03:04:51.704804+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:04:51.704804+0000","last_undegraded":"2024-09-22T03:04:51.704804+0000","last_fullsized":"2024-09-22T03:04:51.704804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'551","reported_seq":576,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:50.333304+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:04:50.333304+0000","last_peered":"2024-09-22T03:04:50.333304+0000","last_clean":"2024-09-22T03:04:50.333304+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:04:50.333304+0000","last_undegraded":"2024-09-22T03:04:50.333304+0000","last_fullsized":"2024-09-22T03:04:50.333304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'407","reported_seq":432,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.522938+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:04:51.522938+0000","last_peered":"2024-09-22T03:04:51.522938+0000","last_clean":"2024-09-22T03:04:51.522938+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:04:51.522938+0000","last_undegraded":"2024-09-22T03:04:51.522938+0000","last_fullsized":"2024-09-22T03:04:51.522938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'472","reported_seq":497,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.685334+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:04:51.685334+0000","last_peered":"2024-09-22T03:04:51.685334+0000","last_clean":"2024-09-22T03:04:51.685334+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:04:51.685334+0000","last_undegraded":"2024-09-22T03:04:51.685334+0000","last_fullsized":"2024-09-22T03:04:51.685334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3874816,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":3784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'527","reported_seq":552,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.531532+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:04:51.531532+0000","last_peered":"2024-09-22T03:04:51.531532+0000","last_clean":"2024-09-22T03:04:51.531532+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:04:51.531532+0000","last_undegraded":"2024-09-22T03:04:51.531532+0000","last_fullsized":"2024-09-22T03:04:51.531532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'471","reported_seq":496,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.283577+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:04:51.283577+0000","last_peered":"2024-09-22T03:04:51.283577+0000","last_clean":"2024-09-22T03:04:51.283577+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:04:51.283577+0000","last_undegraded":"2024-09-22T03:04:51.283577+0000","last_fullsized":"2024-09-22T03:04:51.283577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'511","reported_seq":536,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.453193+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:04:51.453193+0000","last_peered":"2024-09-22T03:04:51.453193+0000","last_clean":"2024-09-22T03:04:51.453193+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:04:51.453193+0000","last_undegraded":"2024-09-22T03:04:51.453193+0000","last_fullsized":"2024-09-22T03:04:51.453193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'511","reported_seq":536,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.650974+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:04:51.650974+0000","last_peered":"2024-09-22T03:04:51.650974+0000","last_clean":"2024-09-22T03:04:51.650974+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:04:51.650974+0000","last_undegraded":"2024-09-22T03:04:51.650974+0000","last_fullsized":"2024-09-22T03:04:51.650974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'511","reported_seq":536,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:50.987625+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:04:50.987625+0000","last_peered":"2024-09-22T03:04:50.987625+0000","last_clean":"2024-09-22T03:04:50.987625+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:04:50.987625+0000","last_undegraded":"2024-09-22T03:04:50.987625+0000","last_fullsized":"2024-09-22T03:04:50.987625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":62070784,"num_objects":948,"num_object_clones":0,"num_object_copies":2844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7577,"num_write_kb":60616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":92860416,"data_stored":185720832,"data_compressed":9586503,"data_compressed_allocated":92860416,"data_compressed_original":185720832,"omap_allocated":0,"internal_metadata":0},"log_size":7561,"ondisk_log_size":7561,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61092,"kb_used_data":25940,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310748,"statfs":{"total":96636764160,"available":96574205952,"internally_reserved":0,"allocated":26562560,"data_stored":52819367,"data_compressed":2723599,"data_compressed_allocated":26382336,"data_compressed_original":52764672,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50844,"kb_used_data":19852,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94320996,"statfs":{"total":96636764160,"available":96584699904,"internally_reserved":0,"allocated":20328448,"data_stored":40818631,"data_compressed":2103602,"data_compressed_allocated":20127744,"data_compressed_original":40747008,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53520,"kb_used_data":22528,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318320,"statfs":{"total":96636764160,"available":96581959680,"internally_reserved":0,"allocated":23068672,"data_stored":46299079,"data_compressed":2386437,"data_compressed_allocated":22867968,"data_compressed_original":46227456,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45756,"kb_used_data":18924,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94326084,"statfs":{"total":96636764160,"available":96589910016,"internally_reserved":0,"allocated":19378176,"data_stored":38926260,"data_compressed":2005905,"data_compressed_allocated":19181568,"data_compressed_original":38854656,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20381696,"data_stored":40763392,"data_compressed":2104114,"data_compressed_allocated":20381696,"data_compressed_original":40763392,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23920640,"data_stored":47841280,"data_compressed":2469418,"data_compressed_allocated":23920640,"data_compressed_original":47841280,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20934656,"data_stored":41869312,"data_compressed":2161203,"data_compressed_allocated":20934656,"data_compressed_original":41869312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27623424,"data_stored":55246848,"data_compressed":2851768,"data_compressed_allocated":27623424,"data_compressed_original":55246848,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:54.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 24 16 8742 8726 2.84028 2.57031 0.0444491 0.0439454 2024-09-22T03:04:55.502 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:55.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:55.638+0000 7ff46bd0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:55.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:55.646+0000 7ff46bd0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:55.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 25 16 9079 9063 2.83197 2.63281 0.0791595 0.0440574 2024-09-22T03:04:56.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 26 16 9404 9388 2.8207 2.53906 0.0509505 0.0442474 2024-09-22T03:04:57.802 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:57.932+0000 7f612e4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:57.937 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 27 16 9730 9714 2.81055 2.54688 0.0312618 0.0444076 2024-09-22T03:04:57.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:57.938+0000 7f612e4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:58.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 28 16 10076 10060 2.8067 2.70312 0.0385301 0.0444967 2024-09-22T03:04:59.818 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:59.818 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:59.818 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:59.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 29 16 10401 10385 2.79747 2.53906 0.0645139 0.0446488 2024-09-22T03:04:59.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:59.938+0000 7f958d0c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:59.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:04:59.950+0000 7f958d0c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:00.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:00.201 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:05:00.202 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:05:00.220 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-22T03:04:58.697213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76268083,"num_objects":1160,"num_object_clones":0,"num_object_copies":3480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":9377,"num_write_kb":75800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9322,"ondisk_log_size":9322,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":252836,"kb_used_data":108068,"kb_used_omap":0,"kb_used_meta":144704,"kb_avail":377234524,"statfs":{"total":386547056640,"available":386288152576,"internally_reserved":0,"allocated":110661632,"data_stored":221510889,"data_compressed":11421681,"data_compressed_allocated":109883392,"data_compressed_original":221241344,"omap_allocated":0,"internal_metadata":148176896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":38748160,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4730,"num_write_kb":37840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001761"},"pg_stats":[{"pgid":"3.f","version":"21'495","reported_seq":520,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:54.937346+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:04:54.937346+0000","last_peered":"2024-09-22T03:04:54.937346+0000","last_clean":"2024-09-22T03:04:54.937346+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:04:54.937346+0000","last_undegraded":"2024-09-22T03:04:54.937346+0000","last_fullsized":"2024-09-22T03:04:54.937346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'535","reported_seq":560,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:56.379253+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:04:56.379253+0000","last_peered":"2024-09-22T03:04:56.379253+0000","last_clean":"2024-09-22T03:04:56.379253+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:04:56.379253+0000","last_undegraded":"2024-09-22T03:04:56.379253+0000","last_fullsized":"2024-09-22T03:04:56.379253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'655","reported_seq":680,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:55.833366+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:04:55.833366+0000","last_peered":"2024-09-22T03:04:55.833366+0000","last_clean":"2024-09-22T03:04:55.833366+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:04:55.833366+0000","last_undegraded":"2024-09-22T03:04:55.833366+0000","last_fullsized":"2024-09-22T03:04:55.833366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'535","reported_seq":560,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:55.100951+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:04:55.100951+0000","last_peered":"2024-09-22T03:04:55.100951+0000","last_clean":"2024-09-22T03:04:55.100951+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:04:55.100951+0000","last_undegraded":"2024-09-22T03:04:55.100951+0000","last_fullsized":"2024-09-22T03:04:55.100951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'503","reported_seq":528,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:56.340548+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:04:56.340548+0000","last_peered":"2024-09-22T03:04:56.340548+0000","last_clean":"2024-09-22T03:04:56.340548+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:04:56.340548+0000","last_undegraded":"2024-09-22T03:04:56.340548+0000","last_fullsized":"2024-09-22T03:04:56.340548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'499","reported_seq":524,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:55.705780+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:04:55.705780+0000","last_peered":"2024-09-22T03:04:55.705780+0000","last_clean":"2024-09-22T03:04:55.705780+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:04:55.705780+0000","last_undegraded":"2024-09-22T03:04:55.705780+0000","last_fullsized":"2024-09-22T03:04:55.705780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096000,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":4000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'543","reported_seq":568,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:55.320908+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:04:55.320908+0000","last_peered":"2024-09-22T03:04:55.320908+0000","last_clean":"2024-09-22T03:04:55.320908+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:04:55.320908+0000","last_undegraded":"2024-09-22T03:04:55.320908+0000","last_fullsized":"2024-09-22T03:04:55.320908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'599","reported_seq":624,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:56.281000+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:04:56.281000+0000","last_peered":"2024-09-22T03:04:56.281000+0000","last_clean":"2024-09-22T03:04:56.281000+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:04:56.281000+0000","last_undegraded":"2024-09-22T03:04:56.281000+0000","last_fullsized":"2024-09-22T03:04:56.281000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'663","reported_seq":688,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:56.455275+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:04:56.455275+0000","last_peered":"2024-09-22T03:04:56.455275+0000","last_clean":"2024-09-22T03:04:56.455275+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:04:56.455275+0000","last_undegraded":"2024-09-22T03:04:56.455275+0000","last_fullsized":"2024-09-22T03:04:56.455275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'495","reported_seq":520,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:56.495161+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:04:56.495161+0000","last_peered":"2024-09-22T03:04:56.495161+0000","last_clean":"2024-09-22T03:04:56.495161+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:04:56.495161+0000","last_undegraded":"2024-09-22T03:04:56.495161+0000","last_fullsized":"2024-09-22T03:04:56.495161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'575","reported_seq":600,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:56.671965+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:04:56.671965+0000","last_peered":"2024-09-22T03:04:56.671965+0000","last_clean":"2024-09-22T03:04:56.671965+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:04:56.671965+0000","last_undegraded":"2024-09-22T03:04:56.671965+0000","last_fullsized":"2024-09-22T03:04:56.671965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'671","reported_seq":696,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:56.610606+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:04:56.610606+0000","last_peered":"2024-09-22T03:04:56.610606+0000","last_clean":"2024-09-22T03:04:56.610606+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:04:56.610606+0000","last_undegraded":"2024-09-22T03:04:56.610606+0000","last_fullsized":"2024-09-22T03:04:56.610606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'583","reported_seq":608,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:56.606069+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:04:56.606069+0000","last_peered":"2024-09-22T03:04:56.606069+0000","last_clean":"2024-09-22T03:04:56.606069+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:04:56.606069+0000","last_undegraded":"2024-09-22T03:04:56.606069+0000","last_fullsized":"2024-09-22T03:04:56.606069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'593","reported_seq":618,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:56.700930+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:04:56.700930+0000","last_peered":"2024-09-22T03:04:56.700930+0000","last_clean":"2024-09-22T03:04:56.700930+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:04:56.700930+0000","last_undegraded":"2024-09-22T03:04:56.700930+0000","last_fullsized":"2024-09-22T03:04:56.700930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4866048,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":594,"num_write_kb":4752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'607","reported_seq":632,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:56.583476+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:04:56.583476+0000","last_peered":"2024-09-22T03:04:56.583476+0000","last_clean":"2024-09-22T03:04:56.583476+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:04:56.583476+0000","last_undegraded":"2024-09-22T03:04:56.583476+0000","last_fullsized":"2024-09-22T03:04:56.583476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'671","reported_seq":696,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:56.331632+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:04:56.331632+0000","last_peered":"2024-09-22T03:04:56.331632+0000","last_clean":"2024-09-22T03:04:56.331632+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:04:56.331632+0000","last_undegraded":"2024-09-22T03:04:56.331632+0000","last_fullsized":"2024-09-22T03:04:56.331632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":75677696,"num_objects":1156,"num_object_clones":0,"num_object_copies":3468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9238,"num_write_kb":73904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113680384,"data_stored":227360768,"data_compressed":11736612,"data_compressed_allocated":113680384,"data_compressed_original":227360768,"omap_allocated":0,"internal_metadata":0},"log_size":9222,"ondisk_log_size":9222,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71316,"kb_used_data":32004,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94300524,"statfs":{"total":96636764160,"available":96563736576,"internally_reserved":0,"allocated":32772096,"data_stored":65238439,"data_compressed":3364867,"data_compressed_allocated":32591872,"data_compressed_original":65183744,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59440,"kb_used_data":24288,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94312400,"statfs":{"total":96636764160,"available":96575897600,"internally_reserved":0,"allocated":24870912,"data_stored":49903559,"data_compressed":2572709,"data_compressed_allocated":24670208,"data_compressed_original":49831936,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62968,"kb_used_data":27816,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94308872,"statfs":{"total":96636764160,"available":96572284928,"internally_reserved":0,"allocated":28483584,"data_stored":57128903,"data_compressed":2945643,"data_compressed_allocated":28282880,"data_compressed_original":57057280,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59112,"kb_used_data":23960,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94312728,"statfs":{"total":96636764160,"available":96576233472,"internally_reserved":0,"allocated":24535040,"data_stored":49239988,"data_compressed":2538462,"data_compressed_allocated":24338432,"data_compressed_original":49168384,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25149440,"data_stored":50298880,"data_compressed":2596486,"data_compressed_allocated":25149440,"data_compressed_original":50298880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29335552,"data_stored":58671104,"data_compressed":3028624,"data_compressed_allocated":29335552,"data_compressed_original":58671104,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25427968,"data_stored":50855936,"data_compressed":2625234,"data_compressed_allocated":25427968,"data_compressed_original":50855936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33767424,"data_stored":67534848,"data_compressed":3486268,"data_compressed_allocated":33767424,"data_compressed_original":67534848,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:00.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:00.242+0000 7f20054b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:00.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:00.248+0000 7f20054b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:00.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 30 16 10717 10701 2.7865 2.46875 0.0249606 0.0448094 2024-09-22T03:05:01.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 31 16 11051 11035 2.78078 2.60938 0.049079 0.0449052 2024-09-22T03:05:02.389 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:02.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:02.509+0000 7fa91c26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:02.514+0000 7fa91c26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:02.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 32 16 11370 11354 2.77176 2.49219 0.0463764 0.0450331 2024-09-22T03:05:03.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 33 16 11713 11697 2.76896 2.67969 0.0506389 0.0450957 2024-09-22T03:05:04.773 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:04.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:04.900+0000 7f1e32b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:04.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:04.905+0000 7f1e32b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:04.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 34 16 12021 12005 2.75829 2.40625 0.0681136 0.0452804 2024-09-22T03:05:05.222 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:05.222 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:05.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:05.346+0000 7fd71f317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:05.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:05.356+0000 7fd71f317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:05.598 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:05:05.598 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:05:05.615 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-22T03:05:04.698255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89539123,"num_objects":1363,"num_object_clones":0,"num_object_copies":4089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":10997,"num_write_kb":88760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10942,"ondisk_log_size":10942,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":280800,"kb_used_data":127708,"kb_used_omap":0,"kb_used_meta":153024,"kb_avail":377206560,"statfs":{"total":386547056640,"available":386259517440,"internally_reserved":0,"allocated":130772992,"data_stored":261733609,"data_compressed":13498611,"data_compressed_allocated":129994752,"data_compressed_original":261464064,"omap_allocated":0,"internal_metadata":156696576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26877952,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3281,"num_write_kb":26248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001896"},"pg_stats":[{"pgid":"3.f","version":"21'639","reported_seq":664,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:00.664186+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:05:00.664186+0000","last_peered":"2024-09-22T03:05:00.664186+0000","last_clean":"2024-09-22T03:05:00.664186+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:05:00.664186+0000","last_undegraded":"2024-09-22T03:05:00.664186+0000","last_fullsized":"2024-09-22T03:05:00.664186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'647","reported_seq":672,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:01.523810+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:05:01.523810+0000","last_peered":"2024-09-22T03:05:01.523810+0000","last_clean":"2024-09-22T03:05:01.523810+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:05:01.523810+0000","last_undegraded":"2024-09-22T03:05:01.523810+0000","last_fullsized":"2024-09-22T03:05:01.523810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'759","reported_seq":784,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:01.710696+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:05:01.710696+0000","last_peered":"2024-09-22T03:05:01.710696+0000","last_clean":"2024-09-22T03:05:01.710696+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:05:01.710696+0000","last_undegraded":"2024-09-22T03:05:01.710696+0000","last_fullsized":"2024-09-22T03:05:01.710696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'631","reported_seq":656,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:00.210644+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:05:00.210644+0000","last_peered":"2024-09-22T03:05:00.210644+0000","last_clean":"2024-09-22T03:05:00.210644+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:05:00.210644+0000","last_undegraded":"2024-09-22T03:05:00.210644+0000","last_fullsized":"2024-09-22T03:05:00.210644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'591","reported_seq":616,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:01.487967+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:05:01.487967+0000","last_peered":"2024-09-22T03:05:01.487967+0000","last_clean":"2024-09-22T03:05:01.487967+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:05:01.487967+0000","last_undegraded":"2024-09-22T03:05:01.487967+0000","last_fullsized":"2024-09-22T03:05:01.487967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'627","reported_seq":652,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:00.699943+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:05:00.699943+0000","last_peered":"2024-09-22T03:05:00.699943+0000","last_clean":"2024-09-22T03:05:00.699943+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:05:00.699943+0000","last_undegraded":"2024-09-22T03:05:00.699943+0000","last_fullsized":"2024-09-22T03:05:00.699943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5144576,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":5024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'647","reported_seq":672,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:00.499018+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:05:00.499018+0000","last_peered":"2024-09-22T03:05:00.499018+0000","last_clean":"2024-09-22T03:05:00.499018+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:05:00.499018+0000","last_undegraded":"2024-09-22T03:05:00.499018+0000","last_fullsized":"2024-09-22T03:05:00.499018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'711","reported_seq":736,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:01.475476+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:05:01.475476+0000","last_peered":"2024-09-22T03:05:01.475476+0000","last_clean":"2024-09-22T03:05:01.475476+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:05:01.475476+0000","last_undegraded":"2024-09-22T03:05:01.475476+0000","last_fullsized":"2024-09-22T03:05:01.475476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'791","reported_seq":816,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:01.407340+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:05:01.407340+0000","last_peered":"2024-09-22T03:05:01.407340+0000","last_clean":"2024-09-22T03:05:01.407340+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:05:01.407340+0000","last_undegraded":"2024-09-22T03:05:01.407340+0000","last_fullsized":"2024-09-22T03:05:01.407340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'607","reported_seq":632,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:01.296512+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:05:01.296512+0000","last_peered":"2024-09-22T03:05:01.296512+0000","last_clean":"2024-09-22T03:05:01.296512+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:05:01.296512+0000","last_undegraded":"2024-09-22T03:05:01.296512+0000","last_fullsized":"2024-09-22T03:05:01.296512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'658","reported_seq":683,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:01.704761+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:05:01.704761+0000","last_peered":"2024-09-22T03:05:01.704761+0000","last_clean":"2024-09-22T03:05:01.704761+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:05:01.704761+0000","last_undegraded":"2024-09-22T03:05:01.704761+0000","last_fullsized":"2024-09-22T03:05:01.704761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5398528,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":659,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'759","reported_seq":784,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:00.301068+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:05:00.301068+0000","last_peered":"2024-09-22T03:05:00.301068+0000","last_clean":"2024-09-22T03:05:00.301068+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:05:00.301068+0000","last_undegraded":"2024-09-22T03:05:00.301068+0000","last_fullsized":"2024-09-22T03:05:00.301068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'663","reported_seq":688,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:58.586562+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:04:58.586562+0000","last_peered":"2024-09-22T03:04:58.586562+0000","last_clean":"2024-09-22T03:04:58.586562+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:04:58.586562+0000","last_undegraded":"2024-09-22T03:04:58.586562+0000","last_fullsized":"2024-09-22T03:04:58.586562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'655","reported_seq":680,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:01.568888+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:05:01.568888+0000","last_peered":"2024-09-22T03:05:01.568888+0000","last_clean":"2024-09-22T03:05:01.568888+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:05:01.568888+0000","last_undegraded":"2024-09-22T03:05:01.568888+0000","last_fullsized":"2024-09-22T03:05:01.568888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'679","reported_seq":704,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:01.416738+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:05:01.416738+0000","last_peered":"2024-09-22T03:05:01.416738+0000","last_clean":"2024-09-22T03:05:01.416738+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:05:01.416738+0000","last_undegraded":"2024-09-22T03:05:01.416738+0000","last_fullsized":"2024-09-22T03:05:01.416738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'778","reported_seq":803,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:01.706819+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:05:01.706819+0000","last_peered":"2024-09-22T03:05:01.706819+0000","last_clean":"2024-09-22T03:05:01.706819+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:05:01.706819+0000","last_undegraded":"2024-09-22T03:05:01.706819+0000","last_fullsized":"2024-09-22T03:05:01.706819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6381568,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":6232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":88948736,"num_objects":1359,"num_object_clones":0,"num_object_copies":4077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10858,"num_write_kb":86864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":133812224,"data_stored":267624448,"data_compressed":13815657,"data_compressed_allocated":133812224,"data_compressed_original":267624448,"omap_allocated":0,"internal_metadata":0},"log_size":10842,"ondisk_log_size":10842,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68632,"kb_used_data":37640,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303208,"statfs":{"total":96636764160,"available":96566484992,"internally_reserved":0,"allocated":38543360,"data_stored":76780967,"data_compressed":3960874,"data_compressed_allocated":38363136,"data_compressed_original":76726272,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67992,"kb_used_data":28680,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94303848,"statfs":{"total":96636764160,"available":96567140352,"internally_reserved":0,"allocated":29368320,"data_stored":58898375,"data_compressed":3037163,"data_compressed_allocated":29167616,"data_compressed_original":58826752,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76468,"kb_used_data":32996,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94295372,"statfs":{"total":96636764160,"available":96558460928,"internally_reserved":0,"allocated":33787904,"data_stored":67737543,"data_compressed":3493428,"data_compressed_allocated":33587200,"data_compressed_original":67665920,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67708,"kb_used_data":28392,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94304132,"statfs":{"total":96636764160,"available":96567431168,"internally_reserved":0,"allocated":29073408,"data_stored":58316724,"data_compressed":3007146,"data_compressed_allocated":28876800,"data_compressed_original":58245120,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29728768,"data_stored":59457536,"data_compressed":3069400,"data_compressed_allocated":29728768,"data_compressed_original":59457536,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34537472,"data_stored":69074944,"data_compressed":3565834,"data_compressed_allocated":34537472,"data_compressed_original":69074944,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30101504,"data_stored":60203008,"data_compressed":3107877,"data_compressed_allocated":30101504,"data_compressed_original":60203008,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39444480,"data_stored":78888960,"data_compressed":4072546,"data_compressed_allocated":39444480,"data_compressed_original":78888960,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:05.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 35 16 12337 12321 2.75001 2.46875 0.0874016 0.0453888 2024-09-22T03:05:06.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 36 16 12668 12652 2.74545 2.58594 0.0783365 0.0454693 2024-09-22T03:05:07.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:07.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:07.224+0000 7f6d1bed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:07.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:07.231+0000 7f6d1bed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:07.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 37 16 13017 13001 2.74493 2.72656 0.0521955 0.0455108 2024-09-22T03:05:08.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 38 16 13331 13315 2.73725 2.45312 0.0519119 0.0456279 2024-09-22T03:05:09.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:09.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:09.462+0000 7f880a0d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:09.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:09.468+0000 7f880a0d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:09.938 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 39 16 13657 13641 2.73236 2.54688 0.0302847 0.0457037 2024-09-22T03:05:10.617 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:10.617 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:10.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:10.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:10.736+0000 7f692f997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:10.746+0000 7f692f997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:10.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:05:10.938215+0000 min lat: 0.00903024 max lat: 0.182354 avg lat: 0.0458134 2024-09-22T03:05:10.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:05:10.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 40 16 13979 13963 2.72694 2.51562 0.0540983 0.0458134 2024-09-22T03:05:10.991 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:05:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:05:11.004 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-22T03:05:10.699221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":103195187,"num_objects":1571,"num_object_clones":0,"num_object_copies":4713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":12664,"num_write_kb":102096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12609,"ondisk_log_size":12609,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":283620,"kb_used_data":147172,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377203740,"statfs":{"total":386547056640,"available":386256629760,"internally_reserved":0,"allocated":150704128,"data_stored":301595881,"data_compressed":15556926,"data_compressed_allocated":149925888,"data_compressed_original":301326336,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26927104,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3287,"num_write_kb":26296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002008"},"pg_stats":[{"pgid":"3.f","version":"21'719","reported_seq":744,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:05.566607+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:05:05.566607+0000","last_peered":"2024-09-22T03:05:05.566607+0000","last_clean":"2024-09-22T03:05:05.566607+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:05:05.566607+0000","last_undegraded":"2024-09-22T03:05:05.566607+0000","last_fullsized":"2024-09-22T03:05:05.566607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'719","reported_seq":744,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.354157+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:05:06.354157+0000","last_peered":"2024-09-22T03:05:06.354157+0000","last_clean":"2024-09-22T03:05:06.354157+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:05:06.354157+0000","last_undegraded":"2024-09-22T03:05:06.354157+0000","last_fullsized":"2024-09-22T03:05:06.354157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'839","reported_seq":864,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.382320+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:05:06.382320+0000","last_peered":"2024-09-22T03:05:06.382320+0000","last_clean":"2024-09-22T03:05:06.382320+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:05:06.382320+0000","last_undegraded":"2024-09-22T03:05:06.382320+0000","last_fullsized":"2024-09-22T03:05:06.382320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'739","reported_seq":764,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:05.704349+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:05:05.704349+0000","last_peered":"2024-09-22T03:05:05.704349+0000","last_clean":"2024-09-22T03:05:05.704349+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:05:05.704349+0000","last_undegraded":"2024-09-22T03:05:05.704349+0000","last_fullsized":"2024-09-22T03:05:05.704349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6062080,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":5920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'696","reported_seq":721,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.057385+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:05:06.057385+0000","last_peered":"2024-09-22T03:05:06.057385+0000","last_clean":"2024-09-22T03:05:06.057385+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:05:06.057385+0000","last_undegraded":"2024-09-22T03:05:06.057385+0000","last_fullsized":"2024-09-22T03:05:06.057385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5709824,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":697,"num_write_kb":5576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'711","reported_seq":736,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:05.485124+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:05:05.485124+0000","last_peered":"2024-09-22T03:05:05.485124+0000","last_clean":"2024-09-22T03:05:05.485124+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:05:05.485124+0000","last_undegraded":"2024-09-22T03:05:05.485124+0000","last_fullsized":"2024-09-22T03:05:05.485124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'743","reported_seq":768,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:04.659657+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:05:04.659657+0000","last_peered":"2024-09-22T03:05:04.659657+0000","last_clean":"2024-09-22T03:05:04.659657+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:05:04.659657+0000","last_undegraded":"2024-09-22T03:05:04.659657+0000","last_fullsized":"2024-09-22T03:05:04.659657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'815","reported_seq":840,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.588100+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:05:06.588100+0000","last_peered":"2024-09-22T03:05:06.588100+0000","last_clean":"2024-09-22T03:05:06.588100+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:05:06.588100+0000","last_undegraded":"2024-09-22T03:05:06.588100+0000","last_fullsized":"2024-09-22T03:05:06.588100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'879","reported_seq":904,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.662689+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:05:06.662689+0000","last_peered":"2024-09-22T03:05:06.662689+0000","last_clean":"2024-09-22T03:05:06.662689+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:05:06.662689+0000","last_undegraded":"2024-09-22T03:05:06.662689+0000","last_fullsized":"2024-09-22T03:05:06.662689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'727","reported_seq":752,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.558770+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:05:06.558770+0000","last_peered":"2024-09-22T03:05:06.558770+0000","last_clean":"2024-09-22T03:05:06.558770+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:05:06.558770+0000","last_undegraded":"2024-09-22T03:05:06.558770+0000","last_fullsized":"2024-09-22T03:05:06.558770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'791","reported_seq":816,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.616710+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:05:06.616710+0000","last_peered":"2024-09-22T03:05:06.616710+0000","last_clean":"2024-09-22T03:05:06.616710+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:05:06.616710+0000","last_undegraded":"2024-09-22T03:05:06.616710+0000","last_fullsized":"2024-09-22T03:05:06.616710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'887","reported_seq":912,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.377647+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:05:06.377647+0000","last_peered":"2024-09-22T03:05:06.377647+0000","last_clean":"2024-09-22T03:05:06.377647+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:05:06.377647+0000","last_undegraded":"2024-09-22T03:05:06.377647+0000","last_fullsized":"2024-09-22T03:05:06.377647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'743","reported_seq":768,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:05.095935+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:05:05.095935+0000","last_peered":"2024-09-22T03:05:05.095935+0000","last_clean":"2024-09-22T03:05:05.095935+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:05:05.095935+0000","last_undegraded":"2024-09-22T03:05:05.095935+0000","last_fullsized":"2024-09-22T03:05:05.095935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'751","reported_seq":776,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.417720+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:05:06.417720+0000","last_peered":"2024-09-22T03:05:06.417720+0000","last_clean":"2024-09-22T03:05:06.417720+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:05:06.417720+0000","last_undegraded":"2024-09-22T03:05:06.417720+0000","last_fullsized":"2024-09-22T03:05:06.417720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'815","reported_seq":840,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.513871+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:05:06.513871+0000","last_peered":"2024-09-22T03:05:06.513871+0000","last_clean":"2024-09-22T03:05:06.513871+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:05:06.513871+0000","last_undegraded":"2024-09-22T03:05:06.513871+0000","last_fullsized":"2024-09-22T03:05:06.513871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'935","reported_seq":960,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.705678+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:05:06.705678+0000","last_peered":"2024-09-22T03:05:06.705678+0000","last_clean":"2024-09-22T03:05:06.705678+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:05:06.705678+0000","last_undegraded":"2024-09-22T03:05:06.705678+0000","last_fullsized":"2024-09-22T03:05:06.705678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":102604800,"num_objects":1567,"num_object_clones":0,"num_object_copies":4701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12525,"num_write_kb":100200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":153993216,"data_stored":307986432,"data_compressed":15899775,"data_compressed_allocated":153993216,"data_compressed_original":307986432,"omap_allocated":0,"internal_metadata":0},"log_size":12509,"ondisk_log_size":12509,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78596,"kb_used_data":43444,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94293244,"statfs":{"total":96636764160,"available":96556281856,"internally_reserved":0,"allocated":44486656,"data_stored":88667559,"data_compressed":4574646,"data_compressed_allocated":44306432,"data_compressed_original":88612864,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60096,"kb_used_data":33264,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94311744,"statfs":{"total":96636764160,"available":96575225856,"internally_reserved":0,"allocated":34062336,"data_stored":68286407,"data_compressed":3521920,"data_compressed_allocated":33861632,"data_compressed_original":68214784,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68624,"kb_used_data":37632,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303216,"statfs":{"total":96636764160,"available":96566493184,"internally_reserved":0,"allocated":38535168,"data_stored":77232071,"data_compressed":3983684,"data_compressed_allocated":38334464,"data_compressed_original":77160448,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76304,"kb_used_data":32832,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94295536,"statfs":{"total":96636764160,"available":96558628864,"internally_reserved":0,"allocated":33619968,"data_stored":67409844,"data_compressed":3476676,"data_compressed_allocated":33423360,"data_compressed_original":67338240,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34357248,"data_stored":68714496,"data_compressed":3547390,"data_compressed_allocated":34357248,"data_compressed_original":68714496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39280640,"data_stored":78561280,"data_compressed":4055667,"data_compressed_allocated":39280640,"data_compressed_original":78561280,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34865152,"data_stored":69730304,"data_compressed":3599825,"data_compressed_allocated":34865152,"data_compressed_original":69730304,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45490176,"data_stored":90980352,"data_compressed":4696893,"data_compressed_allocated":45490176,"data_compressed_original":90980352,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:11.626 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:11.774+0000 7fa0dc597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:11.781+0000 7fa0dc597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:11.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 41 16 14300 14284 2.72159 2.50781 0.0296208 0.0459025 2024-09-22T03:05:12.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 42 16 14599 14583 2.7124 2.33594 0.0274001 0.0460362 2024-09-22T03:05:13.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 43 16 14906 14890 2.70509 2.39844 0.0475907 0.0461673 2024-09-22T03:05:13.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:14.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:14.131+0000 7f5416f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:14.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:14.138+0000 7f5416f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:14.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 44 16 15191 15175 2.69421 2.22656 0.040653 0.0463556 2024-09-22T03:05:15.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 45 16 15497 15481 2.68746 2.39062 0.0560216 0.0464601 2024-09-22T03:05:16.005 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:16.006 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:16.006 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:05:16.006 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:05:16.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:16.144+0000 7f1517517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:16.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:16.480 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:16.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:16.154+0000 7f1517517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:16.480 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:16.480 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:16.480 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:16.480 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:16.480 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:16.480 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:16.481 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:16.481 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:16.481 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:16.481 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:16.481 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:16.481 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:16.481 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:16.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:05:16.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:16.667+0000 7f3d8eece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:16.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:16.664+0000 7f6e2a597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:16.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:16.674+0000 7f3d8eece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:16.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:16.674+0000 7f6e2a597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:16.700 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:16.700 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:16.700 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:16.700 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:16.700 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:16.700 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:16.701 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:16.701 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:16.701 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:16.701 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:16.701 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:16.701 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:16.703 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:16.704 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:16.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:05:16.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:16.846+0000 7f460f06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:16.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:16.858+0000 7f460f06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:16.882 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:16.883 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:16.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:05:16.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 46 16 15792 15776 2.67914 2.30469 0.0376365 0.0466308 2024-09-22T03:05:17.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:17.001+0000 7f504bd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:17.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:17.012+0000 7f504bd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:17.031 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:17.032 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:17.032 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:17.032 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:17.032 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:17.032 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:17.032 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:17.032 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:17.032 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:17.032 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:17.032 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:17.032 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:17.035 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:17.035 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:17.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 47 15 16087 16072 2.67134 2.3125 0.0574428 0.0467587 2024-09-22T03:05:18.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:18.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:18.896+0000 7fa5c94d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:18.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:18.902+0000 7fa5c94d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:18.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 48 16 16393 16377 2.66532 2.38281 0.039641 0.0468697 2024-09-22T03:05:19.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 49 16 16669 16653 2.65493 2.15625 0.085564 0.0470469 2024-09-22T03:05:20.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 50 16 16976 16960 2.6498 2.39844 0.0315397 0.0471525 2024-09-22T03:05:21.100 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:21.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:21.208+0000 7f22e3197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:21.213+0000 7f22e3197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:21.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 51 16 17251 17235 2.63996 2.14844 0.0748256 0.0473188 2024-09-22T03:05:22.036 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:22.036 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:22.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:22.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:22.153+0000 7f1cd3597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:22.162+0000 7f1cd3597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:22.397 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:05:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:05:22.411 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-09-22T03:05:20.701105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128614963,"num_objects":1958,"num_object_clones":0,"num_object_copies":5874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":15767,"num_write_kb":126920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15712,"ondisk_log_size":15712,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":325936,"kb_used_data":185328,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377161424,"statfs":{"total":386547056640,"available":386213298176,"internally_reserved":0,"allocated":189775872,"data_stored":379739369,"data_compressed":19591923,"data_compressed_allocated":188997632,"data_compressed_original":379469824,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25419776,"num_objects":387,"num_object_clones":0,"num_object_copies":1161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3103,"num_write_kb":24824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002267"},"pg_stats":[{"pgid":"3.f","version":"21'927","reported_seq":952,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:15.673514+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:05:15.673514+0000","last_peered":"2024-09-22T03:05:15.673514+0000","last_clean":"2024-09-22T03:05:15.673514+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:05:15.673514+0000","last_undegraded":"2024-09-22T03:05:15.673514+0000","last_fullsized":"2024-09-22T03:05:15.673514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'863","reported_seq":888,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:14.873936+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:05:14.873936+0000","last_peered":"2024-09-22T03:05:14.873936+0000","last_clean":"2024-09-22T03:05:14.873936+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:05:14.873936+0000","last_undegraded":"2024-09-22T03:05:14.873936+0000","last_fullsized":"2024-09-22T03:05:14.873936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1047","reported_seq":1072,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.314097+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:05:16.314097+0000","last_peered":"2024-09-22T03:05:16.314097+0000","last_clean":"2024-09-22T03:05:16.314097+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:05:16.314097+0000","last_undegraded":"2024-09-22T03:05:16.314097+0000","last_fullsized":"2024-09-22T03:05:16.314097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'935","reported_seq":960,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:12.215677+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:05:12.215677+0000","last_peered":"2024-09-22T03:05:12.215677+0000","last_clean":"2024-09-22T03:05:12.215677+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:05:12.215677+0000","last_undegraded":"2024-09-22T03:05:12.215677+0000","last_fullsized":"2024-09-22T03:05:12.215677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'887","reported_seq":912,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:15.965106+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:05:15.965106+0000","last_peered":"2024-09-22T03:05:15.965106+0000","last_clean":"2024-09-22T03:05:15.965106+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:05:15.965106+0000","last_undegraded":"2024-09-22T03:05:15.965106+0000","last_fullsized":"2024-09-22T03:05:15.965106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'909","reported_seq":934,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:15.704883+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:05:15.704883+0000","last_peered":"2024-09-22T03:05:15.704883+0000","last_clean":"2024-09-22T03:05:15.704883+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:05:15.704883+0000","last_undegraded":"2024-09-22T03:05:15.704883+0000","last_fullsized":"2024-09-22T03:05:15.704883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7454720,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":910,"num_write_kb":7280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'903","reported_seq":928,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:15.175145+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:05:15.175145+0000","last_peered":"2024-09-22T03:05:15.175145+0000","last_clean":"2024-09-22T03:05:15.175145+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:05:15.175145+0000","last_undegraded":"2024-09-22T03:05:15.175145+0000","last_fullsized":"2024-09-22T03:05:15.175145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'1055","reported_seq":1080,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.658478+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:05:16.658478+0000","last_peered":"2024-09-22T03:05:16.658478+0000","last_clean":"2024-09-22T03:05:16.658478+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:05:16.658478+0000","last_undegraded":"2024-09-22T03:05:16.658478+0000","last_fullsized":"2024-09-22T03:05:16.658478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1055,"log_dups_size":0,"ondisk_log_size":1055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1056,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1071","reported_seq":1096,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.245410+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:05:16.245410+0000","last_peered":"2024-09-22T03:05:16.245410+0000","last_clean":"2024-09-22T03:05:16.245410+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:05:16.245410+0000","last_undegraded":"2024-09-22T03:05:16.245410+0000","last_fullsized":"2024-09-22T03:05:16.245410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'903","reported_seq":928,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.609912+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:05:16.609912+0000","last_peered":"2024-09-22T03:05:16.609912+0000","last_clean":"2024-09-22T03:05:16.609912+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:05:16.609912+0000","last_undegraded":"2024-09-22T03:05:16.609912+0000","last_fullsized":"2024-09-22T03:05:16.609912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'943","reported_seq":968,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.659938+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:05:16.659938+0000","last_peered":"2024-09-22T03:05:16.659938+0000","last_clean":"2024-09-22T03:05:16.659938+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:05:16.659938+0000","last_undegraded":"2024-09-22T03:05:16.659938+0000","last_fullsized":"2024-09-22T03:05:16.659938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'1127","reported_seq":1152,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.576069+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:05:16.576069+0000","last_peered":"2024-09-22T03:05:16.576069+0000","last_clean":"2024-09-22T03:05:16.576069+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:05:16.576069+0000","last_undegraded":"2024-09-22T03:05:16.576069+0000","last_fullsized":"2024-09-22T03:05:16.576069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'854","reported_seq":879,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.712194+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:05:16.712194+0000","last_peered":"2024-09-22T03:05:16.712194+0000","last_clean":"2024-09-22T03:05:16.712194+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:05:16.712194+0000","last_undegraded":"2024-09-22T03:05:16.712194+0000","last_fullsized":"2024-09-22T03:05:16.712194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7004160,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":6840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'999","reported_seq":1024,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.337807+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:05:16.337807+0000","last_peered":"2024-09-22T03:05:16.337807+0000","last_clean":"2024-09-22T03:05:16.337807+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:05:16.337807+0000","last_undegraded":"2024-09-22T03:05:16.337807+0000","last_fullsized":"2024-09-22T03:05:16.337807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1000,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'1030","reported_seq":1055,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.707368+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:05:16.707368+0000","last_peered":"2024-09-22T03:05:16.707368+0000","last_clean":"2024-09-22T03:05:16.707368+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:05:16.707368+0000","last_undegraded":"2024-09-22T03:05:16.707368+0000","last_fullsized":"2024-09-22T03:05:16.707368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8445952,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1031,"num_write_kb":8248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1159","reported_seq":1184,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.297667+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:05:16.297667+0000","last_peered":"2024-09-22T03:05:16.297667+0000","last_clean":"2024-09-22T03:05:16.297667+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:05:16.297667+0000","last_undegraded":"2024-09-22T03:05:16.297667+0000","last_fullsized":"2024-09-22T03:05:16.297667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":9280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":128024576,"num_objects":1954,"num_object_clones":0,"num_object_copies":5862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15628,"num_write_kb":125024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":192172032,"data_stored":384344064,"data_compressed":19842558,"data_compressed_allocated":192172032,"data_compressed_original":384344064,"omap_allocated":0,"internal_metadata":0},"log_size":15612,"ondisk_log_size":15612,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85664,"kb_used_data":54672,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94286176,"statfs":{"total":96636764160,"available":96549044224,"internally_reserved":0,"allocated":55984128,"data_stored":111662503,"data_compressed":5762007,"data_compressed_allocated":55803904,"data_compressed_original":111607808,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76780,"kb_used_data":41628,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94295060,"statfs":{"total":96636764160,"available":96558141440,"internally_reserved":0,"allocated":42627072,"data_stored":85415879,"data_compressed":4406413,"data_compressed_allocated":42426368,"data_compressed_original":85344256,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86396,"kb_used_data":47084,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94285444,"statfs":{"total":96636764160,"available":96548294656,"internally_reserved":0,"allocated":48214016,"data_stored":96589767,"data_compressed":4983233,"data_compressed_allocated":48013312,"data_compressed_original":96518144,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77096,"kb_used_data":41944,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94294744,"statfs":{"total":96636764160,"available":96557817856,"internally_reserved":0,"allocated":42950656,"data_stored":86071220,"data_compressed":4440270,"data_compressed_allocated":42754048,"data_compressed_original":85999616,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":43520000,"data_stored":87040000,"data_compressed":4493641,"data_compressed_allocated":43520000,"data_compressed_original":87040000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":48906240,"data_stored":97812480,"data_compressed":5049717,"data_compressed_allocated":48906240,"data_compressed_original":97812480,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":43085824,"data_stored":86171648,"data_compressed":4448786,"data_compressed_allocated":43085824,"data_compressed_original":86171648,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":56659968,"data_stored":113319936,"data_compressed":5850414,"data_compressed_allocated":56659968,"data_compressed_original":113319936,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:22.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 52 16 17544 17528 2.63321 2.28906 0.0393465 0.04744 2024-09-22T03:05:23.354 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:23.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:23.473+0000 7f6ad7197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:23.478+0000 7f6ad7197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:23.939 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 53 16 17831 17815 2.62583 2.24219 0.0471629 0.0475744 2024-09-22T03:05:24.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 54 16 18128 18112 2.62017 2.32031 0.0328584 0.0476871 2024-09-22T03:05:25.666 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:25.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:25.772+0000 7fbcdaf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:25.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:25.777+0000 7fbcdaf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:25.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 55 16 18389 18373 2.6096 2.03906 0.0775706 0.047861 2024-09-22T03:05:26.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 56 16 18676 18660 2.60303 2.24219 0.070804 0.0479788 2024-09-22T03:05:27.414 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:27.414 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:27.414 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:05:27.414 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:05:27.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:27.533+0000 7fbb9c7fe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:27.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:27.542+0000 7fbb9c7fe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:27.668 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:27.668 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:27.669 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:05:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:27.789+0000 7fe69d997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:27.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:27.798+0000 7fe69d997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:27.818 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:27.818 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:27.818 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:27.818 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:27.818 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:27.818 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:27.818 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:27.818 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:27.818 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:27.821 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:27.821 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:27.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:05:27.928 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:27.930+0000 7f020c997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:27.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 57 16 18942 18926 2.59382 2.07812 0.0718699 0.0481601 2024-09-22T03:05:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:27.942+0000 7f020c997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:27.974 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:27.975 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:27.975 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:05:28.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:28.081+0000 7f62dc557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:28.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:28.088+0000 7f62dc557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:28.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:28.161+0000 7f0aaa86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:28.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:28.173+0000 7f0aaa86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:28.194 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:28.195 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:28.195 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:28.195 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:28.195 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:28.195 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:28.195 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:28.195 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:28.195 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:28.195 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:28.195 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:28.195 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:28.199 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:28.199 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:28.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 58 16 19224 19208 2.58708 2.20312 0.0631401 0.0482965 2024-09-22T03:05:29.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 59 16 19499 19483 2.57964 2.14844 0.0398986 0.048413 2024-09-22T03:05:30.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:30.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:30.476+0000 7f86b8858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:30.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:30.482+0000 7f86b8858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:30.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:05:30.939807+0000 min lat: 0.00903024 max lat: 0.183484 avg lat: 0.0485608 2024-09-22T03:05:30.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:05:30.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 60 16 19777 19761 2.57285 2.17188 0.0172219 0.0485608 2024-09-22T03:05:31.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 61 16 20076 20060 2.56896 2.33594 0.0916721 0.0486204 2024-09-22T03:05:32.626 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:32.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:32.745+0000 7f7451397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:32.751+0000 7f7451397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:32.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 62 16 20346 20330 2.56154 2.10938 0.0699363 0.0487705 2024-09-22T03:05:33.200 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:33.200 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:33.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:33.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:33.330+0000 7f39faf57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:33.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:33.339+0000 7f39faf57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:05:33.554 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:05:33.571 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-22T03:05:32.703338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":163914291,"num_objects":2497,"num_object_clones":0,"num_object_copies":7491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":20076,"num_write_kb":161392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20021,"ondisk_log_size":20021,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":400996,"kb_used_data":236772,"kb_used_omap":0,"kb_used_meta":164160,"kb_avail":377086364,"statfs":{"total":386547056640,"available":386136436736,"internally_reserved":0,"allocated":242454528,"data_stored":485096681,"data_compressed":25032126,"data_compressed_allocated":241676288,"data_compressed_original":484827136,"omap_allocated":0,"internal_metadata":168099840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35299328,"num_objects":539,"num_object_clones":0,"num_object_copies":1617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4309,"num_write_kb":34472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002232"},"pg_stats":[{"pgid":"3.f","version":"21'1191","reported_seq":1216,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:30.084517+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:05:30.084517+0000","last_peered":"2024-09-22T03:05:30.084517+0000","last_clean":"2024-09-22T03:05:30.084517+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:05:30.084517+0000","last_undegraded":"2024-09-22T03:05:30.084517+0000","last_fullsized":"2024-09-22T03:05:30.084517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'1183","reported_seq":1208,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:31.680971+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:05:31.680971+0000","last_peered":"2024-09-22T03:05:31.680971+0000","last_clean":"2024-09-22T03:05:31.680971+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:05:31.680971+0000","last_undegraded":"2024-09-22T03:05:31.680971+0000","last_fullsized":"2024-09-22T03:05:31.680971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1183,"log_dups_size":0,"ondisk_log_size":1183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":9472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1351","reported_seq":1376,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:31.592899+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:05:31.592899+0000","last_peered":"2024-09-22T03:05:31.592899+0000","last_clean":"2024-09-22T03:05:31.592899+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:05:31.592899+0000","last_undegraded":"2024-09-22T03:05:31.592899+0000","last_fullsized":"2024-09-22T03:05:31.592899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1351,"log_dups_size":0,"ondisk_log_size":1351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075584,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'1143","reported_seq":1168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:29.714474+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:05:29.714474+0000","last_peered":"2024-09-22T03:05:29.714474+0000","last_clean":"2024-09-22T03:05:29.714474+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:05:29.714474+0000","last_undegraded":"2024-09-22T03:05:29.714474+0000","last_fullsized":"2024-09-22T03:05:29.714474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'1135","reported_seq":1160,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:31.554701+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:05:31.554701+0000","last_peered":"2024-09-22T03:05:31.554701+0000","last_clean":"2024-09-22T03:05:31.554701+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:05:31.554701+0000","last_undegraded":"2024-09-22T03:05:31.554701+0000","last_fullsized":"2024-09-22T03:05:31.554701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1135,"log_dups_size":0,"ondisk_log_size":1135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'1095","reported_seq":1120,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:30.648150+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:05:30.648150+0000","last_peered":"2024-09-22T03:05:30.648150+0000","last_clean":"2024-09-22T03:05:30.648150+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:05:30.648150+0000","last_undegraded":"2024-09-22T03:05:30.648150+0000","last_fullsized":"2024-09-22T03:05:30.648150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1096,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'1119","reported_seq":1144,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:30.699332+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:05:30.699332+0000","last_peered":"2024-09-22T03:05:30.699332+0000","last_clean":"2024-09-22T03:05:30.699332+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:05:30.699332+0000","last_undegraded":"2024-09-22T03:05:30.699332+0000","last_fullsized":"2024-09-22T03:05:30.699332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'1295","reported_seq":1320,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:30.947653+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:05:30.947653+0000","last_peered":"2024-09-22T03:05:30.947653+0000","last_clean":"2024-09-22T03:05:30.947653+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:05:30.947653+0000","last_undegraded":"2024-09-22T03:05:30.947653+0000","last_fullsized":"2024-09-22T03:05:30.947653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10616832,"num_objects":162,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1327","reported_seq":1352,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:31.286954+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:05:31.286954+0000","last_peered":"2024-09-22T03:05:31.286954+0000","last_clean":"2024-09-22T03:05:31.286954+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:05:31.286954+0000","last_undegraded":"2024-09-22T03:05:31.286954+0000","last_fullsized":"2024-09-22T03:05:31.286954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'1223","reported_seq":1248,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:31.627413+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:05:31.627413+0000","last_peered":"2024-09-22T03:05:31.627413+0000","last_clean":"2024-09-22T03:05:31.627413+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:05:31.627413+0000","last_undegraded":"2024-09-22T03:05:31.627413+0000","last_fullsized":"2024-09-22T03:05:31.627413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1223,"log_dups_size":0,"ondisk_log_size":1223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'1247","reported_seq":1272,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:31.707240+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:05:31.707240+0000","last_peered":"2024-09-22T03:05:31.707240+0000","last_clean":"2024-09-22T03:05:31.707240+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:05:31.707240+0000","last_undegraded":"2024-09-22T03:05:31.707240+0000","last_fullsized":"2024-09-22T03:05:31.707240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1247,"log_dups_size":0,"ondisk_log_size":1247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":9984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'1391","reported_seq":1416,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:31.618430+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:05:31.618430+0000","last_peered":"2024-09-22T03:05:31.618430+0000","last_clean":"2024-09-22T03:05:31.618430+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:05:31.618430+0000","last_undegraded":"2024-09-22T03:05:31.618430+0000","last_fullsized":"2024-09-22T03:05:31.618430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1392,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1200","reported_seq":1225,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:31.315754+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:05:31.315754+0000","last_peered":"2024-09-22T03:05:31.315754+0000","last_clean":"2024-09-22T03:05:31.315754+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:05:31.315754+0000","last_undegraded":"2024-09-22T03:05:31.315754+0000","last_fullsized":"2024-09-22T03:05:31.315754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1200,"log_dups_size":0,"ondisk_log_size":1200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9838592,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":9608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'1327","reported_seq":1352,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:31.225760+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:05:31.225760+0000","last_peered":"2024-09-22T03:05:31.225760+0000","last_clean":"2024-09-22T03:05:31.225760+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:05:31.225760+0000","last_undegraded":"2024-09-22T03:05:31.225760+0000","last_fullsized":"2024-09-22T03:05:31.225760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'1239","reported_seq":1264,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:31.455481+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:05:31.455481+0000","last_peered":"2024-09-22T03:05:31.455481+0000","last_clean":"2024-09-22T03:05:31.455481+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:05:31.455481+0000","last_undegraded":"2024-09-22T03:05:31.455481+0000","last_fullsized":"2024-09-22T03:05:31.455481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1239,"log_dups_size":0,"ondisk_log_size":1239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1455","reported_seq":1480,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:31.052046+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:05:31.052046+0000","last_peered":"2024-09-22T03:05:31.052046+0000","last_clean":"2024-09-22T03:05:31.052046+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:05:31.052046+0000","last_undegraded":"2024-09-22T03:05:31.052046+0000","last_fullsized":"2024-09-22T03:05:31.052046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1455,"log_dups_size":0,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":163323904,"num_objects":2493,"num_object_clones":0,"num_object_copies":7479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19937,"num_write_kb":159496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":244908032,"data_stored":489816064,"data_compressed":25288683,"data_compressed_allocated":244908032,"data_compressed_original":489816064,"omap_allocated":0,"internal_metadata":0},"log_size":19921,"ondisk_log_size":19921,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":119236,"kb_used_data":70196,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94252604,"statfs":{"total":96636764160,"available":96514666496,"internally_reserved":0,"allocated":71880704,"data_stored":143455655,"data_compressed":7403670,"data_compressed_allocated":71700480,"data_compressed_original":143400960,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84028,"kb_used_data":53036,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94287812,"statfs":{"total":96636764160,"available":96550719488,"internally_reserved":0,"allocated":54308864,"data_stored":108779463,"data_compressed":5612809,"data_compressed_allocated":54108160,"data_compressed_original":108707840,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113612,"kb_used_data":60412,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94258228,"statfs":{"total":96636764160,"available":96520425472,"internally_reserved":0,"allocated":61861888,"data_stored":123885511,"data_compressed":6392669,"data_compressed_allocated":61661184,"data_compressed_original":123813888,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84120,"kb_used_data":53128,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94287720,"statfs":{"total":96636764160,"available":96550625280,"internally_reserved":0,"allocated":54403072,"data_stored":108976052,"data_compressed":5622978,"data_compressed_allocated":54206464,"data_compressed_original":108904448,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":54849536,"data_stored":109699072,"data_compressed":5663659,"data_compressed_allocated":54849536,"data_compressed_original":109699072,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":62459904,"data_stored":124919808,"data_compressed":6449424,"data_compressed_allocated":62459904,"data_compressed_original":124919808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":54882304,"data_stored":109764608,"data_compressed":5667026,"data_compressed_allocated":54882304,"data_compressed_original":109764608,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":72716288,"data_stored":145432576,"data_compressed":7508574,"data_compressed_allocated":72716288,"data_compressed_original":145432576,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:33.940 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 63 15 20620 20605 2.55498 2.14844 0.0820159 0.0488864 2024-09-22T03:05:34.896 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:34.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 64 16 20903 20887 2.54948 2.20312 0.0388969 0.0489912 2024-09-22T03:05:35.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:35.018+0000 7fa746517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:35.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:35.024+0000 7fa746517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:35.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 65 16 21194 21178 2.54523 2.27344 0.0610691 0.0490771 2024-09-22T03:05:36.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 66 16 21496 21480 2.54241 2.35938 0.0483503 0.0491378 2024-09-22T03:05:37.268 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:37.402+0000 7f9fe5cd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:37.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:37.407+0000 7f9fe5cd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:37.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 67 16 21770 21754 2.53642 2.14062 0.0559096 0.0492567 2024-09-22T03:05:38.574 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:38.574 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:38.574 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:38.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:38.713+0000 7f257cf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:38.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:38.722+0000 7f257cf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:38.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 68 16 22034 22018 2.52944 2.0625 0.0371674 0.0493978 2024-09-22T03:05:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:05:39.013 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:05:39.031 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-22T03:05:38.704441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":175620659,"num_objects":2676,"num_object_clones":0,"num_object_copies":8028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":21505,"num_write_kb":172824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21450,"ondisk_log_size":21450,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":430556,"kb_used_data":253852,"kb_used_omap":0,"kb_used_meta":176640,"kb_avail":377056804,"statfs":{"total":386547056640,"available":386106167296,"internally_reserved":0,"allocated":259944448,"data_stored":520076521,"data_compressed":26838336,"data_compressed_allocated":259166208,"data_compressed_original":519806976,"omap_allocated":0,"internal_metadata":180879360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31825920,"num_objects":486,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3885,"num_write_kb":31080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002212"},"pg_stats":[{"pgid":"3.f","version":"21'1255","reported_seq":1280,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:35.542708+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:05:35.542708+0000","last_peered":"2024-09-22T03:05:35.542708+0000","last_clean":"2024-09-22T03:05:35.542708+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:05:35.542708+0000","last_undegraded":"2024-09-22T03:05:35.542708+0000","last_fullsized":"2024-09-22T03:05:35.542708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1256,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'1295","reported_seq":1320,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:36.621213+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:05:36.621213+0000","last_peered":"2024-09-22T03:05:36.621213+0000","last_clean":"2024-09-22T03:05:36.621213+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:05:36.621213+0000","last_undegraded":"2024-09-22T03:05:36.621213+0000","last_fullsized":"2024-09-22T03:05:36.621213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10616832,"num_objects":162,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1439","reported_seq":1464,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:35.231146+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:05:35.231146+0000","last_peered":"2024-09-22T03:05:35.231146+0000","last_clean":"2024-09-22T03:05:35.231146+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:05:35.231146+0000","last_undegraded":"2024-09-22T03:05:35.231146+0000","last_fullsized":"2024-09-22T03:05:35.231146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1440,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'1223","reported_seq":1248,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:35.270437+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:05:35.270437+0000","last_peered":"2024-09-22T03:05:35.270437+0000","last_clean":"2024-09-22T03:05:35.270437+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:05:35.270437+0000","last_undegraded":"2024-09-22T03:05:35.270437+0000","last_fullsized":"2024-09-22T03:05:35.270437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1223,"log_dups_size":0,"ondisk_log_size":1223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'1207","reported_seq":1232,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:36.406827+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:05:36.406827+0000","last_peered":"2024-09-22T03:05:36.406827+0000","last_clean":"2024-09-22T03:05:36.406827+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:05:36.406827+0000","last_undegraded":"2024-09-22T03:05:36.406827+0000","last_fullsized":"2024-09-22T03:05:36.406827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1207,"log_dups_size":0,"ondisk_log_size":1207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'1182","reported_seq":1207,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:35.708444+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:05:35.708444+0000","last_peered":"2024-09-22T03:05:35.708444+0000","last_clean":"2024-09-22T03:05:35.708444+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:05:35.708444+0000","last_undegraded":"2024-09-22T03:05:35.708444+0000","last_fullsized":"2024-09-22T03:05:35.708444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9691136,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'1223","reported_seq":1248,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:35.142038+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:05:35.142038+0000","last_peered":"2024-09-22T03:05:35.142038+0000","last_clean":"2024-09-22T03:05:35.142038+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:05:35.142038+0000","last_undegraded":"2024-09-22T03:05:35.142038+0000","last_fullsized":"2024-09-22T03:05:35.142038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1223,"log_dups_size":0,"ondisk_log_size":1223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'1407","reported_seq":1432,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:36.639436+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:05:36.639436+0000","last_peered":"2024-09-22T03:05:36.639436+0000","last_clean":"2024-09-22T03:05:36.639436+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:05:36.639436+0000","last_undegraded":"2024-09-22T03:05:36.639436+0000","last_fullsized":"2024-09-22T03:05:36.639436+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1399","reported_seq":1424,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:36.245941+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:05:36.245941+0000","last_peered":"2024-09-22T03:05:36.245941+0000","last_clean":"2024-09-22T03:05:36.245941+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:05:36.245941+0000","last_undegraded":"2024-09-22T03:05:36.245941+0000","last_fullsized":"2024-09-22T03:05:36.245941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1400,"num_write_kb":11200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'1303","reported_seq":1328,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:36.685002+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:05:36.685002+0000","last_peered":"2024-09-22T03:05:36.685002+0000","last_clean":"2024-09-22T03:05:36.685002+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:05:36.685002+0000","last_undegraded":"2024-09-22T03:05:36.685002+0000","last_fullsized":"2024-09-22T03:05:36.685002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'1375","reported_seq":1400,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:36.014515+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:05:36.014515+0000","last_peered":"2024-09-22T03:05:36.014515+0000","last_clean":"2024-09-22T03:05:36.014515+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:05:36.014515+0000","last_undegraded":"2024-09-22T03:05:36.014515+0000","last_fullsized":"2024-09-22T03:05:36.014515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1376,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'1479","reported_seq":1504,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:36.537875+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:05:36.537875+0000","last_peered":"2024-09-22T03:05:36.537875+0000","last_clean":"2024-09-22T03:05:36.537875+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:05:36.537875+0000","last_undegraded":"2024-09-22T03:05:36.537875+0000","last_fullsized":"2024-09-22T03:05:36.537875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1479,"log_dups_size":0,"ondisk_log_size":1479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1480,"num_write_kb":11840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1271","reported_seq":1296,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:36.439740+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:05:36.439740+0000","last_peered":"2024-09-22T03:05:36.439740+0000","last_clean":"2024-09-22T03:05:36.439740+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:05:36.439740+0000","last_undegraded":"2024-09-22T03:05:36.439740+0000","last_fullsized":"2024-09-22T03:05:36.439740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'1440","reported_seq":1465,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:36.568883+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:05:36.568883+0000","last_peered":"2024-09-22T03:05:36.568883+0000","last_clean":"2024-09-22T03:05:36.568883+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:05:36.568883+0000","last_undegraded":"2024-09-22T03:05:36.568883+0000","last_fullsized":"2024-09-22T03:05:36.568883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1440,"log_dups_size":0,"ondisk_log_size":1440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11804672,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1441,"num_write_kb":11528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'1333","reported_seq":1358,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:36.710196+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:05:36.710196+0000","last_peered":"2024-09-22T03:05:36.710196+0000","last_clean":"2024-09-22T03:05:36.710196+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:05:36.710196+0000","last_undegraded":"2024-09-22T03:05:36.710196+0000","last_fullsized":"2024-09-22T03:05:36.710196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1333,"log_dups_size":0,"ondisk_log_size":1333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10928128,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":10672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1519","reported_seq":1544,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:36.678450+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:05:36.678450+0000","last_peered":"2024-09-22T03:05:36.678450+0000","last_clean":"2024-09-22T03:05:36.678450+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:05:36.678450+0000","last_undegraded":"2024-09-22T03:05:36.678450+0000","last_fullsized":"2024-09-22T03:05:36.678450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1519,"log_dups_size":0,"ondisk_log_size":1519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1520,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":175030272,"num_objects":2672,"num_object_clones":0,"num_object_copies":8016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21366,"num_write_kb":170928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262381568,"data_stored":524763136,"data_compressed":27093201,"data_compressed_allocated":262381568,"data_compressed_original":524763136,"omap_allocated":0,"internal_metadata":0},"log_size":21350,"ondisk_log_size":21350,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128316,"kb_used_data":75116,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94243524,"statfs":{"total":96636764160,"available":96505368576,"internally_reserved":0,"allocated":76918784,"data_stored":153531815,"data_compressed":7923960,"data_compressed_allocated":76738560,"data_compressed_original":153477120,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87988,"kb_used_data":56996,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94283852,"statfs":{"total":96636764160,"available":96546664448,"internally_reserved":0,"allocated":58363904,"data_stored":116889543,"data_compressed":6031579,"data_compressed_allocated":58163200,"data_compressed_original":116817920,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122108,"kb_used_data":64748,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94249732,"statfs":{"total":96636764160,"available":96511725568,"internally_reserved":0,"allocated":66301952,"data_stored":132765639,"data_compressed":6851201,"data_compressed_allocated":66101248,"data_compressed_original":132694016,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92144,"kb_used_data":56992,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94279696,"statfs":{"total":96636764160,"available":96542408704,"internally_reserved":0,"allocated":58359808,"data_stored":116889524,"data_compressed":6031596,"data_compressed_allocated":58163200,"data_compressed_original":116817920,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":58814464,"data_stored":117628928,"data_compressed":6073123,"data_compressed_allocated":58814464,"data_compressed_original":117628928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":66916352,"data_stored":133832704,"data_compressed":6909648,"data_compressed_allocated":66916352,"data_compressed_original":133832704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58904576,"data_stored":117809152,"data_compressed":6082412,"data_compressed_allocated":58904576,"data_compressed_original":117809152,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77746176,"data_stored":155492352,"data_compressed":8028018,"data_compressed_allocated":77746176,"data_compressed_original":155492352,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:39.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:39.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:39.767+0000 7f0122357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:39.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:39.772+0000 7f0122357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:39.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 69 15 22311 22296 2.52426 2.17188 0.0287117 0.0495042 2024-09-22T03:05:40.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 70 16 22587 22571 2.51889 2.14844 0.047035 0.049603 2024-09-22T03:05:41.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 71 16 22856 22840 2.51301 2.10156 0.0794759 0.049704 2024-09-22T03:05:41.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:42.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:42.064+0000 7f3fc8157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:42.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:42.069+0000 7f3fc8157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:42.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 72 16 23124 23108 2.50718 2.09375 0.025819 0.0498282 2024-09-22T03:05:43.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 73 16 23417 23401 2.50419 2.28906 0.0419618 0.0498873 2024-09-22T03:05:44.033 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:44.033 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:44.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:44.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:44.152+0000 7f8f67618640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:44.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:44.160+0000 7f8f67618640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:44.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:44.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:44.385+0000 7f9c78d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:44.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:44.391+0000 7f9c78d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:05:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:05:44.449 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-22T03:05:42.705205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":186384947,"num_objects":2841,"num_object_clones":0,"num_object_copies":8523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":22819,"num_write_kb":183336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22764,"ondisk_log_size":22764,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":479200,"kb_used_data":270560,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377008160,"statfs":{"total":386547056640,"available":386056355840,"internally_reserved":0,"allocated":277053440,"data_stored":554294505,"data_compressed":28605204,"data_compressed_allocated":276275200,"data_compressed_original":554024960,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33849344,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4132,"num_write_kb":33056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002162"},"pg_stats":[{"pgid":"3.f","version":"21'1335","reported_seq":1360,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:40.568061+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:05:40.568061+0000","last_peered":"2024-09-22T03:05:40.568061+0000","last_clean":"2024-09-22T03:05:40.568061+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:05:40.568061+0000","last_undegraded":"2024-09-22T03:05:40.568061+0000","last_fullsized":"2024-09-22T03:05:40.568061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1335,"log_dups_size":0,"ondisk_log_size":1335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'1391","reported_seq":1416,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:41.526239+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:05:41.526239+0000","last_peered":"2024-09-22T03:05:41.526239+0000","last_clean":"2024-09-22T03:05:41.526239+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:05:41.526239+0000","last_undegraded":"2024-09-22T03:05:41.526239+0000","last_fullsized":"2024-09-22T03:05:41.526239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1392,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1535","reported_seq":1560,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:40.729061+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:05:40.729061+0000","last_peered":"2024-09-22T03:05:40.729061+0000","last_clean":"2024-09-22T03:05:40.729061+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:05:40.729061+0000","last_undegraded":"2024-09-22T03:05:40.729061+0000","last_fullsized":"2024-09-22T03:05:40.729061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1536,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'1263","reported_seq":1288,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:39.539727+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:05:39.539727+0000","last_peered":"2024-09-22T03:05:39.539727+0000","last_clean":"2024-09-22T03:05:39.539727+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:05:39.539727+0000","last_undegraded":"2024-09-22T03:05:39.539727+0000","last_fullsized":"2024-09-22T03:05:39.539727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1263,"log_dups_size":0,"ondisk_log_size":1263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1264,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'1303","reported_seq":1328,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:40.505842+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:05:40.505842+0000","last_peered":"2024-09-22T03:05:40.505842+0000","last_clean":"2024-09-22T03:05:40.505842+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:05:40.505842+0000","last_undegraded":"2024-09-22T03:05:40.505842+0000","last_fullsized":"2024-09-22T03:05:40.505842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'1223","reported_seq":1248,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:40.534642+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:05:40.534642+0000","last_peered":"2024-09-22T03:05:40.534642+0000","last_clean":"2024-09-22T03:05:40.534642+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:05:40.534642+0000","last_undegraded":"2024-09-22T03:05:40.534642+0000","last_fullsized":"2024-09-22T03:05:40.534642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1223,"log_dups_size":0,"ondisk_log_size":1223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'1311","reported_seq":1336,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:40.655597+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:05:40.655597+0000","last_peered":"2024-09-22T03:05:40.655597+0000","last_clean":"2024-09-22T03:05:40.655597+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:05:40.655597+0000","last_undegraded":"2024-09-22T03:05:40.655597+0000","last_fullsized":"2024-09-22T03:05:40.655597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1311,"log_dups_size":0,"ondisk_log_size":1311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'1503","reported_seq":1528,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:41.592764+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:05:41.592764+0000","last_peered":"2024-09-22T03:05:41.592764+0000","last_clean":"2024-09-22T03:05:41.592764+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:05:41.592764+0000","last_undegraded":"2024-09-22T03:05:41.592764+0000","last_fullsized":"2024-09-22T03:05:41.592764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12320768,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1504,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1479","reported_seq":1504,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:41.658482+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:05:41.658482+0000","last_peered":"2024-09-22T03:05:41.658482+0000","last_clean":"2024-09-22T03:05:41.658482+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:05:41.658482+0000","last_undegraded":"2024-09-22T03:05:41.658482+0000","last_fullsized":"2024-09-22T03:05:41.658482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1479,"log_dups_size":0,"ondisk_log_size":1479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1480,"num_write_kb":11840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'1416","reported_seq":1441,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:41.042829+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:05:41.042829+0000","last_peered":"2024-09-22T03:05:41.042829+0000","last_clean":"2024-09-22T03:05:41.042829+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:05:41.042829+0000","last_undegraded":"2024-09-22T03:05:41.042829+0000","last_fullsized":"2024-09-22T03:05:41.042829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1416,"log_dups_size":0,"ondisk_log_size":1416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11608064,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1417,"num_write_kb":11336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'1423","reported_seq":1448,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:40.608582+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:05:40.608582+0000","last_peered":"2024-09-22T03:05:40.608582+0000","last_clean":"2024-09-22T03:05:40.608582+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:05:40.608582+0000","last_undegraded":"2024-09-22T03:05:40.608582+0000","last_fullsized":"2024-09-22T03:05:40.608582+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11665408,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1424,"num_write_kb":11392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'1535","reported_seq":1560,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:41.237079+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:05:41.237079+0000","last_peered":"2024-09-22T03:05:41.237079+0000","last_clean":"2024-09-22T03:05:41.237079+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:05:41.237079+0000","last_undegraded":"2024-09-22T03:05:41.237079+0000","last_fullsized":"2024-09-22T03:05:41.237079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1536,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1349","reported_seq":1374,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:41.713329+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:05:41.713329+0000","last_peered":"2024-09-22T03:05:41.713329+0000","last_clean":"2024-09-22T03:05:41.713329+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:05:41.713329+0000","last_undegraded":"2024-09-22T03:05:41.713329+0000","last_fullsized":"2024-09-22T03:05:41.713329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11059200,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1350,"num_write_kb":10800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'1567","reported_seq":1592,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:41.517149+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:05:41.517149+0000","last_peered":"2024-09-22T03:05:41.517149+0000","last_clean":"2024-09-22T03:05:41.517149+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:05:41.517149+0000","last_undegraded":"2024-09-22T03:05:41.517149+0000","last_fullsized":"2024-09-22T03:05:41.517149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1567,"log_dups_size":0,"ondisk_log_size":1567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12845056,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1568,"num_write_kb":12544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'1399","reported_seq":1424,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:41.187296+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:05:41.187296+0000","last_peered":"2024-09-22T03:05:41.187296+0000","last_clean":"2024-09-22T03:05:41.187296+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:05:41.187296+0000","last_undegraded":"2024-09-22T03:05:41.187296+0000","last_fullsized":"2024-09-22T03:05:41.187296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1400,"num_write_kb":11200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1632","reported_seq":1657,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:41.630224+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:05:41.630224+0000","last_peered":"2024-09-22T03:05:41.630224+0000","last_clean":"2024-09-22T03:05:41.630224+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:05:41.630224+0000","last_undegraded":"2024-09-22T03:05:41.630224+0000","last_fullsized":"2024-09-22T03:05:41.630224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1632,"log_dups_size":0,"ondisk_log_size":1632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13377536,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1633,"num_write_kb":13064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":185794560,"num_objects":2837,"num_object_clones":0,"num_object_copies":8511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22680,"num_write_kb":181440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279281664,"data_stored":558563328,"data_compressed":28838496,"data_compressed_allocated":279281664,"data_compressed_original":558563328,"omap_allocated":0,"internal_metadata":0},"log_size":22664,"ondisk_log_size":22664,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137524,"kb_used_data":80164,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94234316,"statfs":{"total":96636764160,"available":96495939584,"internally_reserved":0,"allocated":82087936,"data_stored":163870119,"data_compressed":8457785,"data_compressed_allocated":81907712,"data_compressed_original":163815424,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113888,"kb_used_data":60688,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94257952,"statfs":{"total":96636764160,"available":96520142848,"internally_reserved":0,"allocated":62144512,"data_stored":124450759,"data_compressed":6422007,"data_compressed_allocated":61943808,"data_compressed_original":124379136,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113764,"kb_used_data":68884,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94258076,"statfs":{"total":96636764160,"available":96520269824,"internally_reserved":0,"allocated":70537216,"data_stored":141236167,"data_compressed":7288583,"data_compressed_allocated":70336512,"data_compressed_original":141164544,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114024,"kb_used_data":60824,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94257816,"statfs":{"total":96636764160,"available":96520003584,"internally_reserved":0,"allocated":62283776,"data_stored":124737460,"data_compressed":6436829,"data_compressed_allocated":62087168,"data_compressed_original":124665856,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62730240,"data_stored":125460480,"data_compressed":6477510,"data_compressed_allocated":62730240,"data_compressed_original":125460480,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71168000,"data_stored":142336000,"data_compressed":7348722,"data_compressed_allocated":71168000,"data_compressed_original":142336000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62644224,"data_stored":125288448,"data_compressed":6468610,"data_compressed_allocated":62644224,"data_compressed_original":125288448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":82739200,"data_stored":165478400,"data_compressed":8543654,"data_compressed_allocated":82739200,"data_compressed_original":165478400,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:44.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 74 16 23689 23673 2.49906 2.125 0.0413945 0.0499872 2024-09-22T03:05:45.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 75 16 23948 23932 2.49272 2.02344 0.0306088 0.0501149 2024-09-22T03:05:46.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:46.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:46.698+0000 7f670c597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:46.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:46.705+0000 7f670c597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:46.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 76 16 24216 24200 2.48747 2.09375 0.0589623 0.050225 2024-09-22T03:05:47.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 77 16 24474 24458 2.48134 2.01562 0.03972 0.0503381 2024-09-22T03:05:48.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 78 16 24726 24710 2.47477 1.96875 0.0387534 0.050488 2024-09-22T03:05:48.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:49.081+0000 7fbcf8597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:49.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:49.088+0000 7fbcf8597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:49.451 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:49.452 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:49.452 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:05:49.452 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:05:49.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:49.580+0000 7fbda1f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:49.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:49.588+0000 7fbda1f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:49.624 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:49.624 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:49.624 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:49.624 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:49.624 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:49.624 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:49.625 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:49.625 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:49.625 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:49.625 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:49.625 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:49.625 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:49.628 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:49.628 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:49.629 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:05:49.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:49.760+0000 7f47f3597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:49.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:49.770+0000 7f47f3597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:49.816 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:49.816 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:49.817 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:49.817 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:49.817 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:49.817 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:49.817 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:49.817 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:49.817 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:49.817 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:49.817 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:49.817 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:49.820 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:49.820 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:49.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:05:49.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:49.930+0000 7f26cef57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:49.941 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 79 16 24996 24980 2.47014 2.10938 0.0845341 0.050567 2024-09-22T03:05:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:49.941+0000 7f26cdcf5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:50.000 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:50.000 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:50.000 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:50.000 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:50.000 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:50.000 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:50.000 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:50.000 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:50.000 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:50.000 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:50.001 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:50.001 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:50.003 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:50.003 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:50.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:05:50.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:50.131+0000 7fe414797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:50.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:50.144+0000 7fe414797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:50.159 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:50.159 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:50.159 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:50.159 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:50.159 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:50.159 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:50.160 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:50.160 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:50.160 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:50.160 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:50.160 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:50.160 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:50.162 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:50.162 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:50.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:05:50.941407+0000 min lat: 0.00903024 max lat: 0.183484 avg lat: 0.0507243 2024-09-22T03:05:50.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:05:50.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 80 16 25239 25223 2.46299 1.89844 0.0596182 0.0507243 2024-09-22T03:05:51.246 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:51.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:51.368+0000 7f890f597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:51.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:51.374+0000 7f890f597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:51.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 81 16 25486 25470 2.4564 1.92969 0.0578297 0.050861 2024-09-22T03:05:52.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 82 16 25758 25742 2.45236 2.125 0.0567472 0.0509489 2024-09-22T03:05:53.525 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:53.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:53.654+0000 7f6921b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:53.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:53.659+0000 7f6921b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:53.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 83 16 26020 26004 2.44747 2.04688 0.0234241 0.0510441 2024-09-22T03:05:54.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 84 16 26284 26268 2.44289 2.0625 0.102072 0.0511437 2024-09-22T03:05:55.164 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:55.164 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:55.164 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:05:55.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:05:55.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:55.288+0000 7fd1e8317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:55.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:55.297+0000 7fd1e8317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:55.316 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:55.316 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:55.316 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:55.316 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:55.316 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:55.316 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:55.316 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:55.316 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:55.317 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:55.317 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:55.317 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:55.317 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:55.320 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:55.320 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:55.320 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:05:55.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:55.436+0000 7f705c597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:55.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:55.448+0000 7f705c597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:55.553 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:55.553 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:55.554 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:55.554 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:55.554 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:55.554 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:55.554 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:55.554 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:55.554 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:55.554 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:55.554 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:55.554 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:55.556 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:55.557 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:55.557 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:05:55.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:55.682+0000 7f35e042c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:55.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:55.692+0000 7f35e042c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:55.720 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:55.720 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:55.720 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:55.720 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:55.720 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:55.720 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:55.720 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:55.720 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:55.720 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:55.724 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:55.725 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:55.725 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:05:55.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:55.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:55.857+0000 7f29ab66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:55.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:55.875+0000 7f29ab66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:05:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:05:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:05:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:05:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:05:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:05:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:05:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:05:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:05:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:05:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:05:55.902 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:55.902 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:55.927+0000 7efd6d117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:55.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:55.933+0000 7efd6d117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:55.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 85 16 26546 26530 2.43823 2.04688 0.0394099 0.0512376 2024-09-22T03:05:56.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 86 16 26821 26805 2.43486 2.14844 0.0266325 0.0513146 2024-09-22T03:05:57.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 87 16 27089 27073 2.43093 2.09375 0.0514021 0.0513994 2024-09-22T03:05:58.063 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:58.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:58.192+0000 7fe509d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:58.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:05:58.199+0000 7fe509d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:58.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 88 16 27333 27317 2.42497 1.90625 0.0750743 0.051509 2024-09-22T03:05:59.942 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 89 16 27579 27563 2.41931 1.92188 0.0676691 0.0516427 2024-09-22T03:06:00.410 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:00.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:00.534+0000 7f51ccf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:00.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:00.540+0000 7f51ccf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:00.903 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:00.903 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:00.904 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:00.943 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 90 14 27832 27818 2.41457 1.99219 0.0616265 0.0517437 2024-09-22T03:06:01.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:01.015+0000 7f8f7b117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:01.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:01.022+0000 7f8f7b117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:01.200 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:06:01.201 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:06:01.213 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-22T03:06:00.708431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":219357747,"num_objects":3344,"num_object_clones":0,"num_object_copies":10032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":26844,"num_write_kb":215536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26789,"ondisk_log_size":26789,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":526848,"kb_used_data":318208,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":376960512,"statfs":{"total":386547056640,"available":386007564288,"internally_reserved":0,"allocated":325844992,"data_stored":651877609,"data_compressed":33643980,"data_compressed_allocated":325066752,"data_compressed_original":651608064,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21233664,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2592,"num_write_kb":20736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002092"},"pg_stats":[{"pgid":"3.f","version":"21'1599","reported_seq":1624,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:54.496678+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:05:54.496678+0000","last_peered":"2024-09-22T03:05:54.496678+0000","last_clean":"2024-09-22T03:05:54.496678+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:05:54.496678+0000","last_undegraded":"2024-09-22T03:05:54.496678+0000","last_fullsized":"2024-09-22T03:05:54.496678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1599,"log_dups_size":0,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1600,"num_write_kb":12800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'1671","reported_seq":1696,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:56.657003+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:05:56.657003+0000","last_peered":"2024-09-22T03:05:56.657003+0000","last_clean":"2024-09-22T03:05:56.657003+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:05:56.657003+0000","last_undegraded":"2024-09-22T03:05:56.657003+0000","last_fullsized":"2024-09-22T03:05:56.657003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1671,"log_dups_size":0,"ondisk_log_size":1671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1672,"num_write_kb":13376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1767","reported_seq":1792,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:55.337734+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:05:55.337734+0000","last_peered":"2024-09-22T03:05:55.337734+0000","last_clean":"2024-09-22T03:05:55.337734+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:05:55.337734+0000","last_undegraded":"2024-09-22T03:05:55.337734+0000","last_fullsized":"2024-09-22T03:05:55.337734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483456,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1768,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'1456","reported_seq":1481,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:54.953459+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:05:54.953459+0000","last_peered":"2024-09-22T03:05:54.953459+0000","last_clean":"2024-09-22T03:05:54.953459+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:05:54.953459+0000","last_undegraded":"2024-09-22T03:05:54.953459+0000","last_fullsized":"2024-09-22T03:05:54.953459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1456,"log_dups_size":0,"ondisk_log_size":1456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11935744,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1457,"num_write_kb":11656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'1615","reported_seq":1640,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:56.688975+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:05:56.688975+0000","last_peered":"2024-09-22T03:05:56.688975+0000","last_clean":"2024-09-22T03:05:56.688975+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:05:56.688975+0000","last_undegraded":"2024-09-22T03:05:56.688975+0000","last_fullsized":"2024-09-22T03:05:56.688975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1616,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'1464","reported_seq":1489,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:55.025226+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:05:55.025226+0000","last_peered":"2024-09-22T03:05:55.025226+0000","last_clean":"2024-09-22T03:05:55.025226+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:05:55.025226+0000","last_undegraded":"2024-09-22T03:05:55.025226+0000","last_fullsized":"2024-09-22T03:05:55.025226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1464,"log_dups_size":0,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12001280,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":11720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'1575","reported_seq":1600,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:55.477082+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:05:55.477082+0000","last_peered":"2024-09-22T03:05:55.477082+0000","last_clean":"2024-09-22T03:05:55.477082+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:05:55.477082+0000","last_undegraded":"2024-09-22T03:05:55.477082+0000","last_fullsized":"2024-09-22T03:05:55.477082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1576,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'1807","reported_seq":1832,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:56.394747+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:05:56.394747+0000","last_peered":"2024-09-22T03:05:56.394747+0000","last_clean":"2024-09-22T03:05:56.394747+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:05:56.394747+0000","last_undegraded":"2024-09-22T03:05:56.394747+0000","last_fullsized":"2024-09-22T03:05:56.394747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1807,"log_dups_size":0,"ondisk_log_size":1807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1808,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1735","reported_seq":1760,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:56.583612+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:05:56.583612+0000","last_peered":"2024-09-22T03:05:56.583612+0000","last_clean":"2024-09-22T03:05:56.583612+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:05:56.583612+0000","last_undegraded":"2024-09-22T03:05:56.583612+0000","last_fullsized":"2024-09-22T03:05:56.583612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1736,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'1663","reported_seq":1688,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:55.698361+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:05:55.698361+0000","last_peered":"2024-09-22T03:05:55.698361+0000","last_clean":"2024-09-22T03:05:55.698361+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:05:55.698361+0000","last_undegraded":"2024-09-22T03:05:55.698361+0000","last_fullsized":"2024-09-22T03:05:55.698361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1664,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'1647","reported_seq":1672,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:56.452812+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:05:56.452812+0000","last_peered":"2024-09-22T03:05:56.452812+0000","last_clean":"2024-09-22T03:05:56.452812+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:05:56.452812+0000","last_undegraded":"2024-09-22T03:05:56.452812+0000","last_fullsized":"2024-09-22T03:05:56.452812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1647,"log_dups_size":0,"ondisk_log_size":1647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13500416,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1648,"num_write_kb":13184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'1783","reported_seq":1808,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:56.716622+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:05:56.716622+0000","last_peered":"2024-09-22T03:05:56.716622+0000","last_clean":"2024-09-22T03:05:56.716622+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:05:56.716622+0000","last_undegraded":"2024-09-22T03:05:56.716622+0000","last_fullsized":"2024-09-22T03:05:56.716622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14614528,"num_objects":223,"num_object_clones":0,"num_object_copies":669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":14272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1535","reported_seq":1560,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:55.404640+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:05:55.404640+0000","last_peered":"2024-09-22T03:05:55.404640+0000","last_clean":"2024-09-22T03:05:55.404640+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:05:55.404640+0000","last_undegraded":"2024-09-22T03:05:55.404640+0000","last_fullsized":"2024-09-22T03:05:55.404640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1536,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'1775","reported_seq":1800,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:56.519156+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:05:56.519156+0000","last_peered":"2024-09-22T03:05:56.519156+0000","last_clean":"2024-09-22T03:05:56.519156+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:05:56.519156+0000","last_undegraded":"2024-09-22T03:05:56.519156+0000","last_fullsized":"2024-09-22T03:05:56.519156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1775,"log_dups_size":0,"ondisk_log_size":1775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1776,"num_write_kb":14208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'1639","reported_seq":1664,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:56.422572+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:05:56.422572+0000","last_peered":"2024-09-22T03:05:56.422572+0000","last_clean":"2024-09-22T03:05:56.422572+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:05:56.422572+0000","last_undegraded":"2024-09-22T03:05:56.422572+0000","last_fullsized":"2024-09-22T03:05:56.422572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1639,"log_dups_size":0,"ondisk_log_size":1639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1640,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1958","reported_seq":1983,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:05:56.711225+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:05:56.711225+0000","last_peered":"2024-09-22T03:05:56.711225+0000","last_clean":"2024-09-22T03:05:56.711225+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:05:56.711225+0000","last_undegraded":"2024-09-22T03:05:56.711225+0000","last_fullsized":"2024-09-22T03:05:56.711225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16048128,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1959,"num_write_kb":15672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":218767360,"num_objects":3340,"num_object_clones":0,"num_object_copies":10020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26705,"num_write_kb":213640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327946240,"data_stored":655892480,"data_compressed":33864159,"data_compressed_allocated":327946240,"data_compressed_original":655892480,"omap_allocated":0,"internal_metadata":0},"log_size":26689,"ondisk_log_size":26689,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673059,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":147196,"kb_used_data":93996,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94224644,"statfs":{"total":96636764160,"available":96486035456,"internally_reserved":0,"allocated":96251904,"data_stored":192198055,"data_compressed":9920519,"data_compressed_allocated":96071680,"data_compressed_original":192143360,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673059,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120900,"kb_used_data":71860,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94250940,"statfs":{"total":96636764160,"available":96512962560,"internally_reserved":0,"allocated":73584640,"data_stored":147331015,"data_compressed":7603446,"data_compressed_allocated":73383936,"data_compressed_original":147259392,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673059,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":138284,"kb_used_data":80924,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94233556,"statfs":{"total":96636764160,"available":96495161344,"internally_reserved":0,"allocated":82866176,"data_stored":165894087,"data_compressed":8561813,"data_compressed_allocated":82665472,"data_compressed_original":165822464,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120468,"kb_used_data":71428,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94251372,"statfs":{"total":96636764160,"available":96513404928,"internally_reserved":0,"allocated":73142272,"data_stored":146454452,"data_compressed":7558202,"data_compressed_allocated":72945664,"data_compressed_original":146382848,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73510912,"data_stored":147021824,"data_compressed":7590846,"data_compressed_allocated":73510912,"data_compressed_original":147021824,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83423232,"data_stored":166846464,"data_compressed":8614338,"data_compressed_allocated":83423232,"data_compressed_original":166846464,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":74067968,"data_stored":148135936,"data_compressed":7648357,"data_compressed_allocated":74067968,"data_compressed_original":148135936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":96944128,"data_stored":193888256,"data_compressed":10010618,"data_compressed_allocated":96944128,"data_compressed_original":193888256,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:01.943 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total time run: 90.0446 2024-09-22T03:06:01.943 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total writes made: 27832 2024-09-22T03:06:01.943 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Write size: 8192 2024-09-22T03:06:01.943 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object size: 65536 2024-09-22T03:06:01.943 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Bandwidth (MB/sec): 2.41478 2024-09-22T03:06:01.943 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Bandwidth: 0.333131 2024-09-22T03:06:01.944 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max bandwidth (MB/sec): 3.15625 2024-09-22T03:06:01.944 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min bandwidth (MB/sec): 1.89844 2024-09-22T03:06:01.944 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average IOPS: 309 2024-09-22T03:06:01.944 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev IOPS: 42.6408 2024-09-22T03:06:01.944 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max IOPS: 404 2024-09-22T03:06:01.944 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min IOPS: 243 2024-09-22T03:06:01.944 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average Latency(s): 0.0517483 2024-09-22T03:06:01.944 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Latency(s): 0.022858 2024-09-22T03:06:01.944 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max latency(s): 0.183484 2024-09-22T03:06:01.944 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min latency(s): 0.00903024 2024-09-22T03:06:01.965 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:06:02.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:02.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:02.914+0000 7f8ceab97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:02.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:02.920+0000 7f8ceab97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:05.240 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:05.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:05.370+0000 7fb24b117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:05.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:05.375+0000 7fb24b117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:06.215 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:06.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:06:06.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:06.352+0000 7ff112c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:06.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:06.366+0000 7ff111a0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:07.398 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:06:07.421 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:06:07.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:07.548+0000 7f6eb262c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:07.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:07.559+0000 7f6eb262c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:07.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:07.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:07.735+0000 7f609eb0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:07.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:07.741+0000 7f609eb0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:08.399 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:06:08.418 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:06:08.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:08.546+0000 7f3b90a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:08.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:08.563+0000 7f3b90a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:09.405 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:06:09.423 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:06:09.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:09.568+0000 7fccf7c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:09.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:09.582+0000 7fccf7c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:10.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:10.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:10.237+0000 7f2ee1557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:10.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:10.243+0000 7f2ee1557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:10.414 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:06:10.434 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:06:10.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:10.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:10.604+0000 7f91b0e18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:10.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:10.614+0000 7f91b0e18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:06:10.912 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:06:10.930 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-09-22T03:06:10.710081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":135987787,"num_objects":2071,"num_object_clones":0,"num_object_copies":6213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":29385,"num_write_kb":224553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29330,"ondisk_log_size":29330,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":434396,"kb_used_data":225724,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377052964,"statfs":{"total":386547056640,"available":386102235136,"internally_reserved":0,"allocated":231141376,"data_stored":462445873,"data_compressed":23865858,"data_compressed_allocated":230350848,"data_compressed_original":462176256,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-74645480,"num_objects":-1138,"num_object_clones":0,"num_object_copies":-3414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1140,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000596"},"pg_stats":[{"pgid":"3.f","version":"21'1714","reported_seq":1739,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:05.648548+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:06:05.648548+0000","last_peered":"2024-09-22T03:06:05.648548+0000","last_clean":"2024-09-22T03:06:05.648548+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:06:05.648548+0000","last_undegraded":"2024-09-22T03:06:05.648548+0000","last_fullsized":"2024-09-22T03:06:05.648548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1714,"log_dups_size":0,"ondisk_log_size":1714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1715,"num_write_kb":13184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'1837","reported_seq":1862,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.542564+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:06:06.542564+0000","last_peered":"2024-09-22T03:06:06.542564+0000","last_clean":"2024-09-22T03:06:06.542564+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:06:06.542564+0000","last_undegraded":"2024-09-22T03:06:06.542564+0000","last_fullsized":"2024-09-22T03:06:06.542564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1837,"log_dups_size":0,"ondisk_log_size":1837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1838,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1916","reported_seq":1942,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.696908+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:06:06.696908+0000","last_peered":"2024-09-22T03:06:06.696908+0000","last_clean":"2024-09-22T03:06:06.696908+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:06:06.696908+0000","last_undegraded":"2024-09-22T03:06:06.696908+0000","last_fullsized":"2024-09-22T03:06:06.696908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1916,"log_dups_size":0,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323096,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1917,"num_write_kb":14529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'1589","reported_seq":1614,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:05.645514+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:06:05.645514+0000","last_peered":"2024-09-22T03:06:05.645514+0000","last_clean":"2024-09-22T03:06:05.645514+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:06:05.645514+0000","last_undegraded":"2024-09-22T03:06:05.645514+0000","last_fullsized":"2024-09-22T03:06:05.645514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1590,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'1812","reported_seq":1837,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.631902+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:06:06.631902+0000","last_peered":"2024-09-22T03:06:06.631902+0000","last_clean":"2024-09-22T03:06:06.631902+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:06:06.631902+0000","last_undegraded":"2024-09-22T03:06:06.631902+0000","last_fullsized":"2024-09-22T03:06:06.631902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1812,"log_dups_size":0,"ondisk_log_size":1812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1813,"num_write_kb":13824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'1616","reported_seq":1641,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:05.663101+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:06:05.663101+0000","last_peered":"2024-09-22T03:06:05.663101+0000","last_clean":"2024-09-22T03:06:05.663101+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:06:05.663101+0000","last_undegraded":"2024-09-22T03:06:05.663101+0000","last_fullsized":"2024-09-22T03:06:05.663101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1616,"log_dups_size":0,"ondisk_log_size":1616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1617,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'1727","reported_seq":1752,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:05.640841+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:06:05.640841+0000","last_peered":"2024-09-22T03:06:05.640841+0000","last_clean":"2024-09-22T03:06:05.640841+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:06:05.640841+0000","last_undegraded":"2024-09-22T03:06:05.640841+0000","last_fullsized":"2024-09-22T03:06:05.640841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1727,"log_dups_size":0,"ondisk_log_size":1727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1728,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'1974","reported_seq":1999,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.568522+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:06:06.568522+0000","last_peered":"2024-09-22T03:06:06.568522+0000","last_clean":"2024-09-22T03:06:06.568522+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:06:06.568522+0000","last_undegraded":"2024-09-22T03:06:06.568522+0000","last_fullsized":"2024-09-22T03:06:06.568522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1974,"log_dups_size":0,"ondisk_log_size":1974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1975,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1914","reported_seq":1939,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.715031+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:06:06.715031+0000","last_peered":"2024-09-22T03:06:06.715031+0000","last_clean":"2024-09-22T03:06:06.715031+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:06:06.715031+0000","last_undegraded":"2024-09-22T03:06:06.715031+0000","last_fullsized":"2024-09-22T03:06:06.715031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1915,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'1779","reported_seq":1804,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.564969+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:06:06.564969+0000","last_peered":"2024-09-22T03:06:06.564969+0000","last_clean":"2024-09-22T03:06:06.564969+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:06:06.564969+0000","last_undegraded":"2024-09-22T03:06:06.564969+0000","last_fullsized":"2024-09-22T03:06:06.564969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1779,"log_dups_size":0,"ondisk_log_size":1779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1780,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'1845","reported_seq":1870,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.662940+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:06:06.662940+0000","last_peered":"2024-09-22T03:06:06.662940+0000","last_clean":"2024-09-22T03:06:06.662940+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:06:06.662940+0000","last_undegraded":"2024-09-22T03:06:06.662940+0000","last_fullsized":"2024-09-22T03:06:06.662940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1845,"log_dups_size":0,"ondisk_log_size":1845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1846,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'1953","reported_seq":1978,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.667455+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:06:06.667455+0000","last_peered":"2024-09-22T03:06:06.667455+0000","last_clean":"2024-09-22T03:06:06.667455+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:06:06.667455+0000","last_undegraded":"2024-09-22T03:06:06.667455+0000","last_fullsized":"2024-09-22T03:06:06.667455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1954,"num_write_kb":14784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1706","reported_seq":1731,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.591183+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:06:06.591183+0000","last_peered":"2024-09-22T03:06:06.591183+0000","last_clean":"2024-09-22T03:06:06.591183+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:06:06.591183+0000","last_undegraded":"2024-09-22T03:06:06.591183+0000","last_fullsized":"2024-09-22T03:06:06.591183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1706,"log_dups_size":0,"ondisk_log_size":1706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1707,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'1912","reported_seq":1937,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.694266+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:06:06.694266+0000","last_peered":"2024-09-22T03:06:06.694266+0000","last_clean":"2024-09-22T03:06:06.694266+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:06:06.694266+0000","last_undegraded":"2024-09-22T03:06:06.694266+0000","last_fullsized":"2024-09-22T03:06:06.694266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1913,"num_write_kb":14592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'1804","reported_seq":1829,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.604545+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:06:06.604545+0000","last_peered":"2024-09-22T03:06:06.604545+0000","last_clean":"2024-09-22T03:06:06.604545+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:06:06.604545+0000","last_undegraded":"2024-09-22T03:06:06.604545+0000","last_fullsized":"2024-09-22T03:06:06.604545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1804,"log_dups_size":0,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1805,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'2132","reported_seq":2157,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.696501+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:06:06.696501+0000","last_peered":"2024-09-22T03:06:06.696501+0000","last_clean":"2024-09-22T03:06:06.696501+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:06:06.696501+0000","last_undegraded":"2024-09-22T03:06:06.696501+0000","last_fullsized":"2024-09-22T03:06:06.696501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":2132,"log_dups_size":0,"ondisk_log_size":2132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2133,"num_write_kb":16192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":135397400,"num_objects":2067,"num_object_clones":0,"num_object_copies":6201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":29246,"num_write_kb":222657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":202321920,"data_stored":404619336,"data_compressed":20892813,"data_compressed_allocated":202309632,"data_compressed_original":404619264,"omap_allocated":0,"internal_metadata":0},"log_size":29230,"ondisk_log_size":29230,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":109444,"kb_used_data":64532,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94262396,"statfs":{"total":96636764160,"available":96524693504,"internally_reserved":0,"allocated":66080768,"data_stored":131847615,"data_compressed":6805222,"data_compressed_allocated":65896448,"data_compressed_original":131792896,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107580,"kb_used_data":50220,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94264260,"statfs":{"total":96636764160,"available":96526602240,"internally_reserved":0,"allocated":51425280,"data_stored":103012295,"data_compressed":5315766,"data_compressed_allocated":51224576,"data_compressed_original":102940672,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104128,"kb_used_data":55088,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94267712,"statfs":{"total":96636764160,"available":96530137088,"internally_reserved":0,"allocated":56410112,"data_stored":112973791,"data_compressed":5830135,"data_compressed_allocated":56205312,"data_compressed_original":112902144,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113244,"kb_used_data":55884,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94258596,"statfs":{"total":96636764160,"available":96520802304,"internally_reserved":0,"allocated":57225216,"data_stored":114612172,"data_compressed":5914735,"data_compressed_allocated":57024512,"data_compressed_original":114540544,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50728960,"data_stored":101449752,"data_compressed":5238431,"data_compressed_allocated":50724864,"data_compressed_original":101449728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49254400,"data_stored":98500632,"data_compressed":5086152,"data_compressed_allocated":49250304,"data_compressed_original":98500608,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":44498944,"data_stored":88997888,"data_compressed":4595471,"data_compressed_allocated":44498944,"data_compressed_original":88997888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57839616,"data_stored":115671064,"data_compressed":5972759,"data_compressed_allocated":57835520,"data_compressed_original":115671040,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:10.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:11.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:11.073+0000 7fd990797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:11.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:11.084+0000 7fd990797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:11.353 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:06:11.354 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:06:11.370 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-09-22T03:06:10.710081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":135987787,"num_objects":2071,"num_object_clones":0,"num_object_copies":6213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":29385,"num_write_kb":224553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29330,"ondisk_log_size":29330,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":434396,"kb_used_data":225724,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377052964,"statfs":{"total":386547056640,"available":386102235136,"internally_reserved":0,"allocated":231141376,"data_stored":462445873,"data_compressed":23865858,"data_compressed_allocated":230350848,"data_compressed_original":462176256,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-74645480,"num_objects":-1138,"num_object_clones":0,"num_object_copies":-3414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1140,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000596"},"pg_stats":[{"pgid":"3.f","version":"21'1714","reported_seq":1739,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:05.648548+0000","last_change":"2024-09-22T03:04:29.926735+0000","last_active":"2024-09-22T03:06:05.648548+0000","last_peered":"2024-09-22T03:06:05.648548+0000","last_clean":"2024-09-22T03:06:05.648548+0000","last_became_active":"2024-09-22T03:04:29.922705+0000","last_became_peered":"2024-09-22T03:04:29.922705+0000","last_unstale":"2024-09-22T03:06:05.648548+0000","last_undegraded":"2024-09-22T03:06:05.648548+0000","last_fullsized":"2024-09-22T03:06:05.648548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1714,"log_dups_size":0,"ondisk_log_size":1714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1715,"num_write_kb":13184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'1837","reported_seq":1862,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.542564+0000","last_change":"2024-09-22T03:04:29.937801+0000","last_active":"2024-09-22T03:06:06.542564+0000","last_peered":"2024-09-22T03:06:06.542564+0000","last_clean":"2024-09-22T03:06:06.542564+0000","last_became_active":"2024-09-22T03:04:29.932554+0000","last_became_peered":"2024-09-22T03:04:29.932554+0000","last_unstale":"2024-09-22T03:06:06.542564+0000","last_undegraded":"2024-09-22T03:06:06.542564+0000","last_fullsized":"2024-09-22T03:06:06.542564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1837,"log_dups_size":0,"ondisk_log_size":1837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1838,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1916","reported_seq":1942,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.696908+0000","last_change":"2024-09-22T03:04:29.933369+0000","last_active":"2024-09-22T03:06:06.696908+0000","last_peered":"2024-09-22T03:06:06.696908+0000","last_clean":"2024-09-22T03:06:06.696908+0000","last_became_active":"2024-09-22T03:04:29.929224+0000","last_became_peered":"2024-09-22T03:04:29.929224+0000","last_unstale":"2024-09-22T03:06:06.696908+0000","last_undegraded":"2024-09-22T03:06:06.696908+0000","last_fullsized":"2024-09-22T03:06:06.696908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1916,"log_dups_size":0,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323096,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1917,"num_write_kb":14529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'1589","reported_seq":1614,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:05.645514+0000","last_change":"2024-09-22T03:04:29.946958+0000","last_active":"2024-09-22T03:06:05.645514+0000","last_peered":"2024-09-22T03:06:05.645514+0000","last_clean":"2024-09-22T03:06:05.645514+0000","last_became_active":"2024-09-22T03:04:29.938966+0000","last_became_peered":"2024-09-22T03:04:29.938966+0000","last_unstale":"2024-09-22T03:06:05.645514+0000","last_undegraded":"2024-09-22T03:06:05.645514+0000","last_fullsized":"2024-09-22T03:06:05.645514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1590,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'1812","reported_seq":1837,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.631902+0000","last_change":"2024-09-22T03:04:29.936697+0000","last_active":"2024-09-22T03:06:06.631902+0000","last_peered":"2024-09-22T03:06:06.631902+0000","last_clean":"2024-09-22T03:06:06.631902+0000","last_became_active":"2024-09-22T03:04:29.930225+0000","last_became_peered":"2024-09-22T03:04:29.930225+0000","last_unstale":"2024-09-22T03:06:06.631902+0000","last_undegraded":"2024-09-22T03:06:06.631902+0000","last_fullsized":"2024-09-22T03:06:06.631902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1812,"log_dups_size":0,"ondisk_log_size":1812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1813,"num_write_kb":13824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'1616","reported_seq":1641,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:05.663101+0000","last_change":"2024-09-22T03:04:29.941165+0000","last_active":"2024-09-22T03:06:05.663101+0000","last_peered":"2024-09-22T03:06:05.663101+0000","last_clean":"2024-09-22T03:06:05.663101+0000","last_became_active":"2024-09-22T03:04:29.932756+0000","last_became_peered":"2024-09-22T03:04:29.932756+0000","last_unstale":"2024-09-22T03:06:05.663101+0000","last_undegraded":"2024-09-22T03:06:05.663101+0000","last_fullsized":"2024-09-22T03:06:05.663101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1616,"log_dups_size":0,"ondisk_log_size":1616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1617,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'1727","reported_seq":1752,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:05.640841+0000","last_change":"2024-09-22T03:04:29.943444+0000","last_active":"2024-09-22T03:06:05.640841+0000","last_peered":"2024-09-22T03:06:05.640841+0000","last_clean":"2024-09-22T03:06:05.640841+0000","last_became_active":"2024-09-22T03:04:29.935987+0000","last_became_peered":"2024-09-22T03:04:29.935987+0000","last_unstale":"2024-09-22T03:06:05.640841+0000","last_undegraded":"2024-09-22T03:06:05.640841+0000","last_fullsized":"2024-09-22T03:06:05.640841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1727,"log_dups_size":0,"ondisk_log_size":1727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1728,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'1974","reported_seq":1999,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.568522+0000","last_change":"2024-09-22T03:04:29.975904+0000","last_active":"2024-09-22T03:06:06.568522+0000","last_peered":"2024-09-22T03:06:06.568522+0000","last_clean":"2024-09-22T03:06:06.568522+0000","last_became_active":"2024-09-22T03:04:29.973234+0000","last_became_peered":"2024-09-22T03:04:29.973234+0000","last_unstale":"2024-09-22T03:06:06.568522+0000","last_undegraded":"2024-09-22T03:06:06.568522+0000","last_fullsized":"2024-09-22T03:06:06.568522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1974,"log_dups_size":0,"ondisk_log_size":1974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1975,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.905400+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:04:36.905400+0000","last_peered":"2024-09-22T03:04:36.905400+0000","last_clean":"2024-09-22T03:04:36.905400+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:04:36.905400+0000","last_undegraded":"2024-09-22T03:04:36.905400+0000","last_fullsized":"2024-09-22T03:04:36.905400+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1914","reported_seq":1939,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.715031+0000","last_change":"2024-09-22T03:04:29.950298+0000","last_active":"2024-09-22T03:06:06.715031+0000","last_peered":"2024-09-22T03:06:06.715031+0000","last_clean":"2024-09-22T03:06:06.715031+0000","last_became_active":"2024-09-22T03:04:29.942751+0000","last_became_peered":"2024-09-22T03:04:29.942751+0000","last_unstale":"2024-09-22T03:06:06.715031+0000","last_undegraded":"2024-09-22T03:06:06.715031+0000","last_fullsized":"2024-09-22T03:06:06.715031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1915,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.904719+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:04:36.904719+0000","last_peered":"2024-09-22T03:04:36.904719+0000","last_clean":"2024-09-22T03:04:36.904719+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:04:36.904719+0000","last_undegraded":"2024-09-22T03:04:36.904719+0000","last_fullsized":"2024-09-22T03:04:36.904719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'1779","reported_seq":1804,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.564969+0000","last_change":"2024-09-22T03:04:29.935265+0000","last_active":"2024-09-22T03:06:06.564969+0000","last_peered":"2024-09-22T03:06:06.564969+0000","last_clean":"2024-09-22T03:06:06.564969+0000","last_became_active":"2024-09-22T03:04:29.930432+0000","last_became_peered":"2024-09-22T03:04:29.930432+0000","last_unstale":"2024-09-22T03:06:06.564969+0000","last_undegraded":"2024-09-22T03:06:06.564969+0000","last_fullsized":"2024-09-22T03:06:06.564969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1779,"log_dups_size":0,"ondisk_log_size":1779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1780,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.906640+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:04:36.906640+0000","last_peered":"2024-09-22T03:04:36.906640+0000","last_clean":"2024-09-22T03:04:36.906640+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:04:36.906640+0000","last_undegraded":"2024-09-22T03:04:36.906640+0000","last_fullsized":"2024-09-22T03:04:36.906640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'1845","reported_seq":1870,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.662940+0000","last_change":"2024-09-22T03:04:29.938660+0000","last_active":"2024-09-22T03:06:06.662940+0000","last_peered":"2024-09-22T03:06:06.662940+0000","last_clean":"2024-09-22T03:06:06.662940+0000","last_became_active":"2024-09-22T03:04:29.929931+0000","last_became_peered":"2024-09-22T03:04:29.929931+0000","last_unstale":"2024-09-22T03:06:06.662940+0000","last_undegraded":"2024-09-22T03:06:06.662940+0000","last_fullsized":"2024-09-22T03:06:06.662940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1845,"log_dups_size":0,"ondisk_log_size":1845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1846,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.909804+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:04:36.909804+0000","last_peered":"2024-09-22T03:04:36.909804+0000","last_clean":"2024-09-22T03:04:36.909804+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:04:36.909804+0000","last_undegraded":"2024-09-22T03:04:36.909804+0000","last_fullsized":"2024-09-22T03:04:36.909804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.907735+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:04:36.907735+0000","last_peered":"2024-09-22T03:04:36.907735+0000","last_clean":"2024-09-22T03:04:36.907735+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:04:36.907735+0000","last_undegraded":"2024-09-22T03:04:36.907735+0000","last_fullsized":"2024-09-22T03:04:36.907735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'1953","reported_seq":1978,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.667455+0000","last_change":"2024-09-22T03:04:29.944950+0000","last_active":"2024-09-22T03:06:06.667455+0000","last_peered":"2024-09-22T03:06:06.667455+0000","last_clean":"2024-09-22T03:06:06.667455+0000","last_became_active":"2024-09-22T03:04:29.935858+0000","last_became_peered":"2024-09-22T03:04:29.935858+0000","last_unstale":"2024-09-22T03:06:06.667455+0000","last_undegraded":"2024-09-22T03:06:06.667455+0000","last_fullsized":"2024-09-22T03:06:06.667455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1954,"num_write_kb":14784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1706","reported_seq":1731,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.591183+0000","last_change":"2024-09-22T03:04:29.933968+0000","last_active":"2024-09-22T03:06:06.591183+0000","last_peered":"2024-09-22T03:06:06.591183+0000","last_clean":"2024-09-22T03:06:06.591183+0000","last_became_active":"2024-09-22T03:04:29.927134+0000","last_became_peered":"2024-09-22T03:04:29.927134+0000","last_unstale":"2024-09-22T03:06:06.591183+0000","last_undegraded":"2024-09-22T03:06:06.591183+0000","last_fullsized":"2024-09-22T03:06:06.591183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1706,"log_dups_size":0,"ondisk_log_size":1706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1707,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.915186+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:04:36.915186+0000","last_peered":"2024-09-22T03:04:36.915186+0000","last_clean":"2024-09-22T03:04:36.915186+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:04:36.915186+0000","last_undegraded":"2024-09-22T03:04:36.915186+0000","last_fullsized":"2024-09-22T03:04:36.915186+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'1912","reported_seq":1937,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.694266+0000","last_change":"2024-09-22T03:04:29.934952+0000","last_active":"2024-09-22T03:06:06.694266+0000","last_peered":"2024-09-22T03:06:06.694266+0000","last_clean":"2024-09-22T03:06:06.694266+0000","last_became_active":"2024-09-22T03:04:29.923843+0000","last_became_peered":"2024-09-22T03:04:29.923843+0000","last_unstale":"2024-09-22T03:06:06.694266+0000","last_undegraded":"2024-09-22T03:06:06.694266+0000","last_fullsized":"2024-09-22T03:06:06.694266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1913,"num_write_kb":14592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.910861+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:04:36.910861+0000","last_peered":"2024-09-22T03:04:36.910861+0000","last_clean":"2024-09-22T03:04:36.910861+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:04:36.910861+0000","last_undegraded":"2024-09-22T03:04:36.910861+0000","last_fullsized":"2024-09-22T03:04:36.910861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'1804","reported_seq":1829,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.604545+0000","last_change":"2024-09-22T03:04:29.936011+0000","last_active":"2024-09-22T03:06:06.604545+0000","last_peered":"2024-09-22T03:06:06.604545+0000","last_clean":"2024-09-22T03:06:06.604545+0000","last_became_active":"2024-09-22T03:04:29.929519+0000","last_became_peered":"2024-09-22T03:04:29.929519+0000","last_unstale":"2024-09-22T03:06:06.604545+0000","last_undegraded":"2024-09-22T03:06:06.604545+0000","last_fullsized":"2024-09-22T03:06:06.604545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":1804,"log_dups_size":0,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1805,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919581+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:04:36.919581+0000","last_peered":"2024-09-22T03:04:36.919581+0000","last_clean":"2024-09-22T03:04:36.919581+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:04:36.919581+0000","last_undegraded":"2024-09-22T03:04:36.919581+0000","last_fullsized":"2024-09-22T03:04:36.919581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'2132","reported_seq":2157,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.696501+0000","last_change":"2024-09-22T03:04:29.936283+0000","last_active":"2024-09-22T03:06:06.696501+0000","last_peered":"2024-09-22T03:06:06.696501+0000","last_clean":"2024-09-22T03:06:06.696501+0000","last_became_active":"2024-09-22T03:04:29.930516+0000","last_became_peered":"2024-09-22T03:04:29.930516+0000","last_unstale":"2024-09-22T03:06:06.696501+0000","last_undegraded":"2024-09-22T03:06:06.696501+0000","last_fullsized":"2024-09-22T03:06:06.696501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:28.853398+0000","last_clean_scrub_stamp":"2024-09-22T03:04:28.853398+0000","objects_scrubbed":0,"log_size":2132,"log_dups_size":0,"ondisk_log_size":2132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2133,"num_write_kb":16192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.919915+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:04:36.919915+0000","last_peered":"2024-09-22T03:04:36.919915+0000","last_clean":"2024-09-22T03:04:36.919915+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:04:36.919915+0000","last_undegraded":"2024-09-22T03:04:36.919915+0000","last_fullsized":"2024-09-22T03:04:36.919915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":135397400,"num_objects":2067,"num_object_clones":0,"num_object_copies":6201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":29246,"num_write_kb":222657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":202321920,"data_stored":404619336,"data_compressed":20892813,"data_compressed_allocated":202309632,"data_compressed_original":404619264,"omap_allocated":0,"internal_metadata":0},"log_size":29230,"ondisk_log_size":29230,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":109444,"kb_used_data":64532,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94262396,"statfs":{"total":96636764160,"available":96524693504,"internally_reserved":0,"allocated":66080768,"data_stored":131847615,"data_compressed":6805222,"data_compressed_allocated":65896448,"data_compressed_original":131792896,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107580,"kb_used_data":50220,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94264260,"statfs":{"total":96636764160,"available":96526602240,"internally_reserved":0,"allocated":51425280,"data_stored":103012295,"data_compressed":5315766,"data_compressed_allocated":51224576,"data_compressed_original":102940672,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104128,"kb_used_data":55088,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94267712,"statfs":{"total":96636764160,"available":96530137088,"internally_reserved":0,"allocated":56410112,"data_stored":112973791,"data_compressed":5830135,"data_compressed_allocated":56205312,"data_compressed_original":112902144,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113244,"kb_used_data":55884,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94258596,"statfs":{"total":96636764160,"available":96520802304,"internally_reserved":0,"allocated":57225216,"data_stored":114612172,"data_compressed":5914735,"data_compressed_allocated":57024512,"data_compressed_original":114540544,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50728960,"data_stored":101449752,"data_compressed":5238431,"data_compressed_allocated":50724864,"data_compressed_original":101449728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49254400,"data_stored":98500632,"data_compressed":5086152,"data_compressed_allocated":49250304,"data_compressed_original":98500608,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":44498944,"data_stored":88997888,"data_compressed":4595471,"data_compressed_allocated":44498944,"data_compressed_original":88997888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57839616,"data_stored":115671064,"data_compressed":5972759,"data_compressed_allocated":57835520,"data_compressed_original":115671040,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:11.371 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:06:11.371 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:11.371 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:06:11.372 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:06:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:11.510+0000 7f03590d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:11.523+0000 7f03590d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:11.631 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:11.631 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:11.631 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:11.631 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:11.631 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:11.631 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:11.632 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:11.632 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:11.632 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:11.632 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:11.632 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:11.632 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:11.635 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:11.635 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:11.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:06:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:11.773+0000 7f357e197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:11.786+0000 7f357e197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:11.865 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:11.865 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:11.866 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:11.866 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:11.866 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:11.866 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:11.866 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:11.866 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:11.866 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:11.866 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:11.866 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:11.866 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:11.869 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:11.870 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:11.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:06:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:12.008+0000 7fbee1b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:12.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:12.021+0000 7fbee1b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:12.093 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:12.093 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:12.093 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:12.093 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:12.093 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:12.093 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:12.094 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:12.094 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:12.094 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:12.094 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:12.094 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:12.094 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:12.097 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:12.098 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:12.098 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:06:12.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:12.244+0000 7fa8fce58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:12.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:12.258+0000 7fa8fce58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:12.311 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:12.314 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:12.314 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:12.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:12.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:12.531+0000 7fe1eb46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:12.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:12.536+0000 7fe1eb46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:13.213 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Removed 3479 objects 2024-09-22T03:06:13.213 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Clean up completed and total clean up time :11.2487 2024-09-22T03:06:14.601 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-22T03:06:14.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-22T03:06:14.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:14.714+0000 7f1578997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:14.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:14.725+0000 7f1578997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:14.805 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:14.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:14.905+0000 7f4594397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:14.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:14.910+0000 7f4594397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:15.771 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_0' removed 2024-09-22T03:06:15.790 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:06:15.791 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:06:15.791 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2024-09-22T03:06:15.791 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2024-09-22T03:06:15.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:15.918+0000 7f13ab62c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:15.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:15.932+0000 7f13ab62c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:16.775 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_1' created 2024-09-22T03:06:16.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-09-22T03:06:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:16.921+0000 7f870346c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:16.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:16.932+0000 7f870346c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:16.982 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:17.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:17.082+0000 7f277aafa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:17.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:17.087+0000 7f277aafa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:17.315 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:17.315 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:17.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:17.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:17.416+0000 7f2d40c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:17.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:17.423+0000 7f2d40c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:06:17.601 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:06:17.613 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-09-22T03:06:16.775875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":201364,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":200256,"kb_avail":377285996,"statfs":{"total":386547056640,"available":386340859904,"internally_reserved":0,"allocated":1069056,"data_stored":2052016,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":205062144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-135397400,"num_objects":-2067,"num_object_clones":0,"num_object_copies":-6201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-29246,"num_write_kb":-222657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.361322"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:06:15.792208+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:15.792208+0000","last_peered":"2024-09-22T03:06:15.792208+0000","last_clean":"2024-09-22T03:06:15.792208+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:15.792208+0000","last_undegraded":"2024-09-22T03:06:15.792208+0000","last_fullsized":"2024-09-22T03:06:15.792208+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:10.429460+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:10.429460+0000","last_peered":"2024-09-22T03:06:10.429460+0000","last_clean":"2024-09-22T03:06:10.429460+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:10.429460+0000","last_undegraded":"2024-09-22T03:06:10.429460+0000","last_fullsized":"2024-09-22T03:06:10.429460+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:06:15.786103+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:15.786103+0000","last_peered":"2024-09-22T03:06:15.786103+0000","last_clean":"2024-09-22T03:06:15.786103+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:15.786103+0000","last_undegraded":"2024-09-22T03:06:15.786103+0000","last_fullsized":"2024-09-22T03:06:15.786103+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:06:15.815226+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:15.815226+0000","last_peered":"2024-09-22T03:06:15.815226+0000","last_clean":"2024-09-22T03:06:15.815226+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:15.815226+0000","last_undegraded":"2024-09-22T03:06:15.815226+0000","last_fullsized":"2024-09-22T03:06:15.815226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:10.436640+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:10.436640+0000","last_peered":"2024-09-22T03:06:10.436640+0000","last_clean":"2024-09-22T03:06:10.436640+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:10.436640+0000","last_undegraded":"2024-09-22T03:06:10.436640+0000","last_fullsized":"2024-09-22T03:06:10.436640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:06:15.780057+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:15.780057+0000","last_peered":"2024-09-22T03:06:15.780057+0000","last_clean":"2024-09-22T03:06:15.780057+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:15.780057+0000","last_undegraded":"2024-09-22T03:06:15.780057+0000","last_fullsized":"2024-09-22T03:06:15.780057+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:06:15.798890+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:15.798890+0000","last_peered":"2024-09-22T03:06:15.798890+0000","last_clean":"2024-09-22T03:06:15.798890+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:15.798890+0000","last_undegraded":"2024-09-22T03:06:15.798890+0000","last_fullsized":"2024-09-22T03:06:15.798890+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:06:15.808748+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:15.808748+0000","last_peered":"2024-09-22T03:06:15.808748+0000","last_clean":"2024-09-22T03:06:15.808748+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:15.808748+0000","last_undegraded":"2024-09-22T03:06:15.808748+0000","last_fullsized":"2024-09-22T03:06:15.808748+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:06:16.771291+0000","last_change":"2024-09-22T03:06:16.771291+0000","last_active":"2024-09-22T03:06:16.771291+0000","last_peered":"2024-09-22T03:06:16.771291+0000","last_clean":"2024-09-22T03:06:16.771291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:06:16.771291+0000","last_undegraded":"2024-09-22T03:06:16.771291+0000","last_fullsized":"2024-09-22T03:06:16.771291+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:06:15.811126+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:15.811126+0000","last_peered":"2024-09-22T03:06:15.811126+0000","last_clean":"2024-09-22T03:06:15.811126+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:15.811126+0000","last_undegraded":"2024-09-22T03:06:15.811126+0000","last_fullsized":"2024-09-22T03:06:15.811126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53420,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94318420,"statfs":{"total":96636764160,"available":96582062080,"internally_reserved":0,"allocated":225280,"data_stored":71048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45160,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94326680,"statfs":{"total":96636764160,"available":96590520320,"internally_reserved":0,"allocated":286720,"data_stored":661416,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57640,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94314200,"statfs":{"total":96636764160,"available":96577740800,"internally_reserved":0,"allocated":286720,"data_stored":661416,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45144,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94326696,"statfs":{"total":96636764160,"available":96590536704,"internally_reserved":0,"allocated":270336,"data_stored":658136,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:17.776 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-09-22T03:06:18.794 DEBUG:teuthology.orchestra.run.smithi134:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-09-22T03:06:18.796 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:06:18.796 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:06:18.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:hints = 1 2024-09-22T03:06:18.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:06:18.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object prefix: benchmark_data_smithi134_34281 2024-09-22T03:06:18.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:06:18.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:06:19.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:19.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:19.314+0000 7f2216ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:19.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:19.321+0000 7f2216ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:19.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 1 16 356 340 2.65604 2.65625 0.0567284 0.045382 2024-09-22T03:06:20.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 2 16 763 747 2.91775 3.17969 0.0156778 0.0425356 2024-09-22T03:06:21.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:21.590+0000 7fc2bf317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:21.595+0000 7fc2bf317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:21.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 3 16 1082 1066 2.77583 2.49219 0.0459568 0.0444891 2024-09-22T03:06:22.616 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:22.616 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:22.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:22.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:22.748+0000 7fb92ff17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:22.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:22.760+0000 7fb92ff17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:22.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 4 16 1465 1449 2.82986 2.99219 0.0361904 0.0439768 2024-09-22T03:06:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:06:23.039 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:06:23.056 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-22T03:06:22.712251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8069683,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":1052,"num_write_kb":9200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":997,"ondisk_log_size":997,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":217564,"kb_used_data":8924,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377269796,"statfs":{"total":386547056640,"available":386324271104,"internally_reserved":0,"allocated":9138176,"data_stored":18015717,"data_compressed":909496,"data_compressed_allocated":8081408,"data_compressed_original":17637376,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7479296,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":913,"num_write_kb":7304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000915"},"pg_stats":[{"pgid":"4.f","version":"29'47","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:20.862364+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:06:20.862364+0000","last_peered":"2024-09-22T03:06:20.862364+0000","last_clean":"2024-09-22T03:06:20.862364+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:06:20.862364+0000","last_undegraded":"2024-09-22T03:06:20.862364+0000","last_fullsized":"2024-09-22T03:06:20.862364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"29'63","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.250180+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:06:21.250180+0000","last_peered":"2024-09-22T03:06:21.250180+0000","last_clean":"2024-09-22T03:06:21.250180+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:06:21.250180+0000","last_undegraded":"2024-09-22T03:06:21.250180+0000","last_fullsized":"2024-09-22T03:06:21.250180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"29'47","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.631626+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:06:21.631626+0000","last_peered":"2024-09-22T03:06:21.631626+0000","last_clean":"2024-09-22T03:06:21.631626+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:06:21.631626+0000","last_undegraded":"2024-09-22T03:06:21.631626+0000","last_fullsized":"2024-09-22T03:06:21.631626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'71","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.694381+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:06:21.694381+0000","last_peered":"2024-09-22T03:06:21.694381+0000","last_clean":"2024-09-22T03:06:21.694381+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:06:21.694381+0000","last_undegraded":"2024-09-22T03:06:21.694381+0000","last_fullsized":"2024-09-22T03:06:21.694381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"29'48","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:20.552289+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:06:20.552289+0000","last_peered":"2024-09-22T03:06:20.552289+0000","last_clean":"2024-09-22T03:06:20.552289+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:06:20.552289+0000","last_undegraded":"2024-09-22T03:06:20.552289+0000","last_fullsized":"2024-09-22T03:06:20.552289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401408,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"29'55","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.479243+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:06:21.479243+0000","last_peered":"2024-09-22T03:06:21.479243+0000","last_clean":"2024-09-22T03:06:21.479243+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:06:21.479243+0000","last_undegraded":"2024-09-22T03:06:21.479243+0000","last_fullsized":"2024-09-22T03:06:21.479243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"29'79","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.646381+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:06:21.646381+0000","last_peered":"2024-09-22T03:06:21.646381+0000","last_clean":"2024-09-22T03:06:21.646381+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:06:21.646381+0000","last_undegraded":"2024-09-22T03:06:21.646381+0000","last_fullsized":"2024-09-22T03:06:21.646381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"29'47","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.331492+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:06:21.331492+0000","last_peered":"2024-09-22T03:06:21.331492+0000","last_clean":"2024-09-22T03:06:21.331492+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:06:21.331492+0000","last_undegraded":"2024-09-22T03:06:21.331492+0000","last_fullsized":"2024-09-22T03:06:21.331492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'39","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.519160+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:06:21.519160+0000","last_peered":"2024-09-22T03:06:21.519160+0000","last_clean":"2024-09-22T03:06:21.519160+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:06:21.519160+0000","last_undegraded":"2024-09-22T03:06:21.519160+0000","last_fullsized":"2024-09-22T03:06:21.519160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797727+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:18.797727+0000","last_peered":"2024-09-22T03:06:18.797727+0000","last_clean":"2024-09-22T03:06:18.797727+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:18.797727+0000","last_undegraded":"2024-09-22T03:06:18.797727+0000","last_fullsized":"2024-09-22T03:06:18.797727+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'63","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.171804+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:06:21.171804+0000","last_peered":"2024-09-22T03:06:21.171804+0000","last_clean":"2024-09-22T03:06:21.171804+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:06:21.171804+0000","last_undegraded":"2024-09-22T03:06:21.171804+0000","last_fullsized":"2024-09-22T03:06:21.171804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801165+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:18.801165+0000","last_peered":"2024-09-22T03:06:18.801165+0000","last_clean":"2024-09-22T03:06:18.801165+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:18.801165+0000","last_undegraded":"2024-09-22T03:06:18.801165+0000","last_fullsized":"2024-09-22T03:06:18.801165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"29'87","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.212419+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:06:21.212419+0000","last_peered":"2024-09-22T03:06:21.212419+0000","last_clean":"2024-09-22T03:06:21.212419+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:06:21.212419+0000","last_undegraded":"2024-09-22T03:06:21.212419+0000","last_fullsized":"2024-09-22T03:06:21.212419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797891+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:18.797891+0000","last_peered":"2024-09-22T03:06:18.797891+0000","last_clean":"2024-09-22T03:06:18.797891+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:18.797891+0000","last_undegraded":"2024-09-22T03:06:18.797891+0000","last_fullsized":"2024-09-22T03:06:18.797891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'23","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:20.401709+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:06:20.401709+0000","last_peered":"2024-09-22T03:06:20.401709+0000","last_clean":"2024-09-22T03:06:20.401709+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:06:20.401709+0000","last_undegraded":"2024-09-22T03:06:20.401709+0000","last_fullsized":"2024-09-22T03:06:20.401709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801352+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:18.801352+0000","last_peered":"2024-09-22T03:06:18.801352+0000","last_clean":"2024-09-22T03:06:18.801352+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:18.801352+0000","last_undegraded":"2024-09-22T03:06:18.801352+0000","last_fullsized":"2024-09-22T03:06:18.801352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803187+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:18.803187+0000","last_peered":"2024-09-22T03:06:18.803187+0000","last_clean":"2024-09-22T03:06:18.803187+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:18.803187+0000","last_undegraded":"2024-09-22T03:06:18.803187+0000","last_fullsized":"2024-09-22T03:06:18.803187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'55","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.100912+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:06:21.100912+0000","last_peered":"2024-09-22T03:06:21.100912+0000","last_clean":"2024-09-22T03:06:21.100912+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:06:21.100912+0000","last_undegraded":"2024-09-22T03:06:21.100912+0000","last_fullsized":"2024-09-22T03:06:21.100912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797975+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:18.797975+0000","last_peered":"2024-09-22T03:06:18.797975+0000","last_clean":"2024-09-22T03:06:18.797975+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:18.797975+0000","last_undegraded":"2024-09-22T03:06:18.797975+0000","last_fullsized":"2024-09-22T03:06:18.797975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'71","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:20.698348+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:06:20.698348+0000","last_peered":"2024-09-22T03:06:20.698348+0000","last_clean":"2024-09-22T03:06:20.698348+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:06:20.698348+0000","last_undegraded":"2024-09-22T03:06:20.698348+0000","last_fullsized":"2024-09-22T03:06:20.698348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.802226+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:18.802226+0000","last_peered":"2024-09-22T03:06:18.802226+0000","last_clean":"2024-09-22T03:06:18.802226+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:18.802226+0000","last_undegraded":"2024-09-22T03:06:18.802226+0000","last_fullsized":"2024-09-22T03:06:18.802226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"29'23","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:20.173923+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:06:20.173923+0000","last_peered":"2024-09-22T03:06:20.173923+0000","last_clean":"2024-09-22T03:06:20.173923+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:06:20.173923+0000","last_undegraded":"2024-09-22T03:06:20.173923+0000","last_fullsized":"2024-09-22T03:06:20.173923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803519+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:18.803519+0000","last_peered":"2024-09-22T03:06:18.803519+0000","last_clean":"2024-09-22T03:06:18.803519+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:18.803519+0000","last_undegraded":"2024-09-22T03:06:18.803519+0000","last_fullsized":"2024-09-22T03:06:18.803519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'79","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.493980+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:06:21.493980+0000","last_peered":"2024-09-22T03:06:21.493980+0000","last_clean":"2024-09-22T03:06:21.493980+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:06:21.493980+0000","last_undegraded":"2024-09-22T03:06:21.493980+0000","last_fullsized":"2024-09-22T03:06:21.493980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.805367+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:18.805367+0000","last_peered":"2024-09-22T03:06:18.805367+0000","last_clean":"2024-09-22T03:06:18.805367+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:18.805367+0000","last_undegraded":"2024-09-22T03:06:18.805367+0000","last_fullsized":"2024-09-22T03:06:18.805367+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":7479296,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":913,"num_write_kb":7304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11673600,"data_stored":23347200,"data_compressed":1202447,"data_compressed_allocated":11673600,"data_compressed_original":23347200,"omap_allocated":0,"internal_metadata":0},"log_size":897,"ondisk_log_size":897,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60140,"kb_used_data":2780,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94311700,"statfs":{"total":96636764160,"available":96575180800,"internally_reserved":0,"allocated":2846720,"data_stored":5275622,"data_compressed":267446,"data_compressed_allocated":2596864,"data_compressed_original":5193728,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51108,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94320732,"statfs":{"total":96636764160,"available":96584429568,"internally_reserved":0,"allocated":2117632,"data_stored":4284934,"data_compressed":216012,"data_compressed_allocated":1847296,"data_compressed_original":4186112,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60076,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94311764,"statfs":{"total":96636764160,"available":96575246336,"internally_reserved":0,"allocated":2781184,"data_stored":5612038,"data_compressed":284324,"data_compressed_allocated":2510848,"data_compressed_original":5513216,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46240,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94325600,"statfs":{"total":96636764160,"available":96589414400,"internally_reserved":0,"allocated":1392640,"data_stored":2843123,"data_compressed":141714,"data_compressed_allocated":1126400,"data_compressed_original":2744320,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2084864,"data_stored":4169728,"data_compressed":214722,"data_compressed_allocated":2084864,"data_compressed_original":4169728,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3407872,"data_stored":6815744,"data_compressed":351034,"data_compressed_allocated":3407872,"data_compressed_original":6815744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2605056,"data_stored":5210112,"data_compressed":268362,"data_compressed_allocated":2605056,"data_compressed_original":5210112,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3575808,"data_stored":7151616,"data_compressed":368329,"data_compressed_allocated":3575808,"data_compressed_original":7151616,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:23.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:23.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 5 16 1867 1851 2.89196 3.14062 0.0707661 0.0430514 2024-09-22T03:06:23.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:23.882+0000 7fb4b5997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:23.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:23.887+0000 7fb4b5997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:24.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 6 16 2218 2202 2.86696 2.74219 0.0166086 0.0434094 2024-09-22T03:06:25.855 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 7 16 2571 2555 2.85134 2.75781 0.0802344 0.0435575 2024-09-22T03:06:26.061 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:26.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:26.212+0000 7fe40aa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:26.223+0000 7fe40aa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:26.856 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 8 16 2930 2914 2.84548 2.80469 0.0403492 0.0437924 2024-09-22T03:06:27.856 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 9 16 3298 3282 2.84873 2.875 0.067427 0.0436639 2024-09-22T03:06:28.058 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:28.058 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:28.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:28.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:28.208+0000 7fe35e26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:28.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:28.217+0000 7fe35e26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:28.439 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:28.548 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:06:28.549 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:06:28.567 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-09-22T03:06:26.712948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":12190259,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":1555,"num_write_kb":13224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1500,"ondisk_log_size":1500,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":231308,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":216896,"kb_avail":377256052,"statfs":{"total":386547056640,"available":386310197248,"internally_reserved":0,"allocated":14692352,"data_stored":29124069,"data_compressed":1482613,"data_compressed_allocated":13635584,"data_compressed_original":28745728,"omap_allocated":0,"internal_metadata":222101504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1416,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.936247"},"pg_stats":[{"pgid":"4.f","version":"29'47","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:20.862364+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:06:20.862364+0000","last_peered":"2024-09-22T03:06:20.862364+0000","last_clean":"2024-09-22T03:06:20.862364+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:06:20.862364+0000","last_undegraded":"2024-09-22T03:06:20.862364+0000","last_fullsized":"2024-09-22T03:06:20.862364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"29'63","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.250180+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:06:21.250180+0000","last_peered":"2024-09-22T03:06:21.250180+0000","last_clean":"2024-09-22T03:06:21.250180+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:06:21.250180+0000","last_undegraded":"2024-09-22T03:06:21.250180+0000","last_fullsized":"2024-09-22T03:06:21.250180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"29'47","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.631626+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:06:21.631626+0000","last_peered":"2024-09-22T03:06:21.631626+0000","last_clean":"2024-09-22T03:06:21.631626+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:06:21.631626+0000","last_undegraded":"2024-09-22T03:06:21.631626+0000","last_fullsized":"2024-09-22T03:06:21.631626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'71","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.694381+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:06:21.694381+0000","last_peered":"2024-09-22T03:06:21.694381+0000","last_clean":"2024-09-22T03:06:21.694381+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:06:21.694381+0000","last_undegraded":"2024-09-22T03:06:21.694381+0000","last_fullsized":"2024-09-22T03:06:21.694381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"29'175","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:25.492647+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:06:25.492647+0000","last_peered":"2024-09-22T03:06:25.492647+0000","last_clean":"2024-09-22T03:06:25.492647+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:06:25.492647+0000","last_undegraded":"2024-09-22T03:06:25.492647+0000","last_fullsized":"2024-09-22T03:06:25.492647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"29'55","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.479243+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:06:21.479243+0000","last_peered":"2024-09-22T03:06:21.479243+0000","last_clean":"2024-09-22T03:06:21.479243+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:06:21.479243+0000","last_undegraded":"2024-09-22T03:06:21.479243+0000","last_fullsized":"2024-09-22T03:06:21.479243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"29'79","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.646381+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:06:21.646381+0000","last_peered":"2024-09-22T03:06:21.646381+0000","last_clean":"2024-09-22T03:06:21.646381+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:06:21.646381+0000","last_undegraded":"2024-09-22T03:06:21.646381+0000","last_fullsized":"2024-09-22T03:06:21.646381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"29'47","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.331492+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:06:21.331492+0000","last_peered":"2024-09-22T03:06:21.331492+0000","last_clean":"2024-09-22T03:06:21.331492+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:06:21.331492+0000","last_undegraded":"2024-09-22T03:06:21.331492+0000","last_fullsized":"2024-09-22T03:06:21.331492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'39","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.519160+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:06:21.519160+0000","last_peered":"2024-09-22T03:06:21.519160+0000","last_clean":"2024-09-22T03:06:21.519160+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:06:21.519160+0000","last_undegraded":"2024-09-22T03:06:21.519160+0000","last_fullsized":"2024-09-22T03:06:21.519160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797727+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:18.797727+0000","last_peered":"2024-09-22T03:06:18.797727+0000","last_clean":"2024-09-22T03:06:18.797727+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:18.797727+0000","last_undegraded":"2024-09-22T03:06:18.797727+0000","last_fullsized":"2024-09-22T03:06:18.797727+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'63","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.171804+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:06:21.171804+0000","last_peered":"2024-09-22T03:06:21.171804+0000","last_clean":"2024-09-22T03:06:21.171804+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:06:21.171804+0000","last_undegraded":"2024-09-22T03:06:21.171804+0000","last_fullsized":"2024-09-22T03:06:21.171804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801165+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:18.801165+0000","last_peered":"2024-09-22T03:06:18.801165+0000","last_clean":"2024-09-22T03:06:18.801165+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:18.801165+0000","last_undegraded":"2024-09-22T03:06:18.801165+0000","last_fullsized":"2024-09-22T03:06:18.801165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"29'87","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.212419+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:06:21.212419+0000","last_peered":"2024-09-22T03:06:21.212419+0000","last_clean":"2024-09-22T03:06:21.212419+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:06:21.212419+0000","last_undegraded":"2024-09-22T03:06:21.212419+0000","last_fullsized":"2024-09-22T03:06:21.212419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797891+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:18.797891+0000","last_peered":"2024-09-22T03:06:18.797891+0000","last_clean":"2024-09-22T03:06:18.797891+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:18.797891+0000","last_undegraded":"2024-09-22T03:06:18.797891+0000","last_fullsized":"2024-09-22T03:06:18.797891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'183","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:25.446199+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:06:25.446199+0000","last_peered":"2024-09-22T03:06:25.446199+0000","last_clean":"2024-09-22T03:06:25.446199+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:06:25.446199+0000","last_undegraded":"2024-09-22T03:06:25.446199+0000","last_fullsized":"2024-09-22T03:06:25.446199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801352+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:18.801352+0000","last_peered":"2024-09-22T03:06:18.801352+0000","last_clean":"2024-09-22T03:06:18.801352+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:18.801352+0000","last_undegraded":"2024-09-22T03:06:18.801352+0000","last_fullsized":"2024-09-22T03:06:18.801352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803187+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:18.803187+0000","last_peered":"2024-09-22T03:06:18.803187+0000","last_clean":"2024-09-22T03:06:18.803187+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:18.803187+0000","last_undegraded":"2024-09-22T03:06:18.803187+0000","last_fullsized":"2024-09-22T03:06:18.803187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'55","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.100912+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:06:21.100912+0000","last_peered":"2024-09-22T03:06:21.100912+0000","last_clean":"2024-09-22T03:06:21.100912+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:06:21.100912+0000","last_undegraded":"2024-09-22T03:06:21.100912+0000","last_fullsized":"2024-09-22T03:06:21.100912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797975+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:18.797975+0000","last_peered":"2024-09-22T03:06:18.797975+0000","last_clean":"2024-09-22T03:06:18.797975+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:18.797975+0000","last_undegraded":"2024-09-22T03:06:18.797975+0000","last_fullsized":"2024-09-22T03:06:18.797975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'199","reported_seq":212,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:25.078399+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:06:25.078399+0000","last_peered":"2024-09-22T03:06:25.078399+0000","last_clean":"2024-09-22T03:06:25.078399+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:06:25.078399+0000","last_undegraded":"2024-09-22T03:06:25.078399+0000","last_fullsized":"2024-09-22T03:06:25.078399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.802226+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:18.802226+0000","last_peered":"2024-09-22T03:06:18.802226+0000","last_clean":"2024-09-22T03:06:18.802226+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:18.802226+0000","last_undegraded":"2024-09-22T03:06:18.802226+0000","last_fullsized":"2024-09-22T03:06:18.802226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"29'111","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:24.983697+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:06:24.983697+0000","last_peered":"2024-09-22T03:06:24.983697+0000","last_clean":"2024-09-22T03:06:24.983697+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:06:24.983697+0000","last_undegraded":"2024-09-22T03:06:24.983697+0000","last_fullsized":"2024-09-22T03:06:24.983697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803519+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:18.803519+0000","last_peered":"2024-09-22T03:06:18.803519+0000","last_clean":"2024-09-22T03:06:18.803519+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:18.803519+0000","last_undegraded":"2024-09-22T03:06:18.803519+0000","last_fullsized":"2024-09-22T03:06:18.803519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'79","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.493980+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:06:21.493980+0000","last_peered":"2024-09-22T03:06:21.493980+0000","last_clean":"2024-09-22T03:06:21.493980+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:06:21.493980+0000","last_undegraded":"2024-09-22T03:06:21.493980+0000","last_fullsized":"2024-09-22T03:06:21.493980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.805367+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:18.805367+0000","last_peered":"2024-09-22T03:06:18.805367+0000","last_clean":"2024-09-22T03:06:18.805367+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:18.805367+0000","last_undegraded":"2024-09-22T03:06:18.805367+0000","last_fullsized":"2024-09-22T03:06:18.805367+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1416,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17293312,"data_stored":34586624,"data_compressed":1782576,"data_compressed_allocated":17293312,"data_compressed_original":34586624,"omap_allocated":0,"internal_metadata":0},"log_size":1400,"ondisk_log_size":1400,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60140,"kb_used_data":2780,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94311700,"statfs":{"total":96636764160,"available":96575180800,"internally_reserved":0,"allocated":2846720,"data_stored":5275622,"data_compressed":267446,"data_compressed_allocated":2596864,"data_compressed_original":5193728,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51108,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94320732,"statfs":{"total":96636764160,"available":96584429568,"internally_reserved":0,"allocated":2117632,"data_stored":4284934,"data_compressed":216012,"data_compressed_allocated":1847296,"data_compressed_original":4186112,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60076,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94311764,"statfs":{"total":96636764160,"available":96575246336,"internally_reserved":0,"allocated":2781184,"data_stored":5612038,"data_compressed":284324,"data_compressed_allocated":2510848,"data_compressed_original":5513216,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705793,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59984,"kb_used_data":6784,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94311856,"statfs":{"total":96636764160,"available":96575340544,"internally_reserved":0,"allocated":6946816,"data_stored":13951475,"data_compressed":714831,"data_compressed_allocated":6680576,"data_compressed_original":13852672,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7704576,"data_stored":15409152,"data_compressed":794851,"data_compressed_allocated":7704576,"data_compressed_original":15409152,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3407872,"data_stored":6815744,"data_compressed":351034,"data_compressed_allocated":3407872,"data_compressed_original":6815744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2605056,"data_stored":5210112,"data_compressed":268362,"data_compressed_allocated":2605056,"data_compressed_original":5210112,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3575808,"data_stored":7151616,"data_compressed":368329,"data_compressed_allocated":3575808,"data_compressed_original":7151616,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:28.591+0000 7f9d49e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:28.598+0000 7f9d49e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:28.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 10 16 3638 3622 2.82947 2.65625 0.0333654 0.0440671 2024-09-22T03:06:29.856 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 11 16 3968 3952 2.8066 2.57812 0.0691019 0.0444627 2024-09-22T03:06:30.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:30.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:30.845+0000 7fec70ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:30.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:30.851+0000 7fec70ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:30.856 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 12 15 4331 4316 2.80968 2.84375 0.0512371 0.0443912 2024-09-22T03:06:31.856 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 13 16 4665 4649 2.79365 2.60156 0.0338433 0.0446344 2024-09-22T03:06:32.856 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 14 16 5029 5013 2.79721 2.84375 0.0908189 0.0445787 2024-09-22T03:06:33.054 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:33.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:33.179+0000 7f8814317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:33.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:33.186+0000 7f8814317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:33.569 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:33.569 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:33.570 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:33.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:33.694+0000 7fb444597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:33.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:33.707+0000 7fb444597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:33.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 15 15 5354 5339 2.78051 2.54688 0.0747226 0.0448353 2024-09-22T03:06:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:06:33.966 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:06:33.986 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-09-22T03:06:32.713992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37749299,"num_objects":571,"num_object_clones":0,"num_object_copies":1713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":4675,"num_write_kb":38184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4620,"ondisk_log_size":4620,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":291068,"kb_used_data":51900,"kb_used_omap":0,"kb_used_meta":239104,"kb_avail":377196292,"statfs":{"total":386547056640,"available":386249003008,"internally_reserved":0,"allocated":53145600,"data_stored":106030565,"data_compressed":5453151,"data_compressed_allocated":52088832,"data_compressed_original":105652224,"omap_allocated":0,"internal_metadata":244842496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":37158912,"num_objects":567,"num_object_clones":0,"num_object_copies":1701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4536,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002000"},"pg_stats":[{"pgid":"4.f","version":"29'263","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:31.256196+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:06:31.256196+0000","last_peered":"2024-09-22T03:06:31.256196+0000","last_clean":"2024-09-22T03:06:31.256196+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:06:31.256196+0000","last_undegraded":"2024-09-22T03:06:31.256196+0000","last_fullsized":"2024-09-22T03:06:31.256196+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"29'303","reported_seq":316,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:31.304741+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:06:31.304741+0000","last_peered":"2024-09-22T03:06:31.304741+0000","last_clean":"2024-09-22T03:06:31.304741+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:06:31.304741+0000","last_undegraded":"2024-09-22T03:06:31.304741+0000","last_fullsized":"2024-09-22T03:06:31.304741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"29'263","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:31.426616+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:06:31.426616+0000","last_peered":"2024-09-22T03:06:31.426616+0000","last_clean":"2024-09-22T03:06:31.426616+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:06:31.426616+0000","last_undegraded":"2024-09-22T03:06:31.426616+0000","last_fullsized":"2024-09-22T03:06:31.426616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'407","reported_seq":420,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:31.684838+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:06:31.684838+0000","last_peered":"2024-09-22T03:06:31.684838+0000","last_clean":"2024-09-22T03:06:31.684838+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:06:31.684838+0000","last_undegraded":"2024-09-22T03:06:31.684838+0000","last_fullsized":"2024-09-22T03:06:31.684838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"29'295","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:30.523138+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:06:30.523138+0000","last_peered":"2024-09-22T03:06:30.523138+0000","last_clean":"2024-09-22T03:06:30.523138+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:06:30.523138+0000","last_undegraded":"2024-09-22T03:06:30.523138+0000","last_fullsized":"2024-09-22T03:06:30.523138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"29'295","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:31.606921+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:06:31.606921+0000","last_peered":"2024-09-22T03:06:31.606921+0000","last_clean":"2024-09-22T03:06:31.606921+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:06:31.606921+0000","last_undegraded":"2024-09-22T03:06:31.606921+0000","last_fullsized":"2024-09-22T03:06:31.606921+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"29'271","reported_seq":284,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:31.577012+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:06:31.577012+0000","last_peered":"2024-09-22T03:06:31.577012+0000","last_clean":"2024-09-22T03:06:31.577012+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:06:31.577012+0000","last_undegraded":"2024-09-22T03:06:31.577012+0000","last_fullsized":"2024-09-22T03:06:31.577012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"29'279","reported_seq":292,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:31.723687+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:06:31.723687+0000","last_peered":"2024-09-22T03:06:31.723687+0000","last_clean":"2024-09-22T03:06:31.723687+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:06:31.723687+0000","last_undegraded":"2024-09-22T03:06:31.723687+0000","last_fullsized":"2024-09-22T03:06:31.723687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'263","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:30.663329+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:06:30.663329+0000","last_peered":"2024-09-22T03:06:30.663329+0000","last_clean":"2024-09-22T03:06:30.663329+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:06:30.663329+0000","last_undegraded":"2024-09-22T03:06:30.663329+0000","last_fullsized":"2024-09-22T03:06:30.663329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797727+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:18.797727+0000","last_peered":"2024-09-22T03:06:18.797727+0000","last_clean":"2024-09-22T03:06:18.797727+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:18.797727+0000","last_undegraded":"2024-09-22T03:06:18.797727+0000","last_fullsized":"2024-09-22T03:06:18.797727+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'255","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:31.215601+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:06:31.215601+0000","last_peered":"2024-09-22T03:06:31.215601+0000","last_clean":"2024-09-22T03:06:31.215601+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:06:31.215601+0000","last_undegraded":"2024-09-22T03:06:31.215601+0000","last_fullsized":"2024-09-22T03:06:31.215601+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801165+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:18.801165+0000","last_peered":"2024-09-22T03:06:18.801165+0000","last_clean":"2024-09-22T03:06:18.801165+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:18.801165+0000","last_undegraded":"2024-09-22T03:06:18.801165+0000","last_fullsized":"2024-09-22T03:06:18.801165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"29'319","reported_seq":332,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:31.385231+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:06:31.385231+0000","last_peered":"2024-09-22T03:06:31.385231+0000","last_clean":"2024-09-22T03:06:31.385231+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:06:31.385231+0000","last_undegraded":"2024-09-22T03:06:31.385231+0000","last_fullsized":"2024-09-22T03:06:31.385231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797891+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:18.797891+0000","last_peered":"2024-09-22T03:06:18.797891+0000","last_clean":"2024-09-22T03:06:18.797891+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:18.797891+0000","last_undegraded":"2024-09-22T03:06:18.797891+0000","last_fullsized":"2024-09-22T03:06:18.797891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'295","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:30.311486+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:06:30.311486+0000","last_peered":"2024-09-22T03:06:30.311486+0000","last_clean":"2024-09-22T03:06:30.311486+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:06:30.311486+0000","last_undegraded":"2024-09-22T03:06:30.311486+0000","last_fullsized":"2024-09-22T03:06:30.311486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801352+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:18.801352+0000","last_peered":"2024-09-22T03:06:18.801352+0000","last_clean":"2024-09-22T03:06:18.801352+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:18.801352+0000","last_undegraded":"2024-09-22T03:06:18.801352+0000","last_fullsized":"2024-09-22T03:06:18.801352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803187+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:18.803187+0000","last_peered":"2024-09-22T03:06:18.803187+0000","last_clean":"2024-09-22T03:06:18.803187+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:18.803187+0000","last_undegraded":"2024-09-22T03:06:18.803187+0000","last_fullsized":"2024-09-22T03:06:18.803187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'239","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:31.654623+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:06:31.654623+0000","last_peered":"2024-09-22T03:06:31.654623+0000","last_clean":"2024-09-22T03:06:31.654623+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:06:31.654623+0000","last_undegraded":"2024-09-22T03:06:31.654623+0000","last_fullsized":"2024-09-22T03:06:31.654623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797975+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:18.797975+0000","last_peered":"2024-09-22T03:06:18.797975+0000","last_clean":"2024-09-22T03:06:18.797975+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:18.797975+0000","last_undegraded":"2024-09-22T03:06:18.797975+0000","last_fullsized":"2024-09-22T03:06:18.797975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'295","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:30.615051+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:06:30.615051+0000","last_peered":"2024-09-22T03:06:30.615051+0000","last_clean":"2024-09-22T03:06:30.615051+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:06:30.615051+0000","last_undegraded":"2024-09-22T03:06:30.615051+0000","last_fullsized":"2024-09-22T03:06:30.615051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.802226+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:18.802226+0000","last_peered":"2024-09-22T03:06:18.802226+0000","last_clean":"2024-09-22T03:06:18.802226+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:18.802226+0000","last_undegraded":"2024-09-22T03:06:18.802226+0000","last_fullsized":"2024-09-22T03:06:18.802226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"29'199","reported_seq":212,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:30.482275+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:06:30.482275+0000","last_peered":"2024-09-22T03:06:30.482275+0000","last_clean":"2024-09-22T03:06:30.482275+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:06:30.482275+0000","last_undegraded":"2024-09-22T03:06:30.482275+0000","last_fullsized":"2024-09-22T03:06:30.482275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803519+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:18.803519+0000","last_peered":"2024-09-22T03:06:18.803519+0000","last_clean":"2024-09-22T03:06:18.803519+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:18.803519+0000","last_undegraded":"2024-09-22T03:06:18.803519+0000","last_fullsized":"2024-09-22T03:06:18.803519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'279","reported_seq":292,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:31.679354+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:06:31.679354+0000","last_peered":"2024-09-22T03:06:31.679354+0000","last_clean":"2024-09-22T03:06:31.679354+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:06:31.679354+0000","last_undegraded":"2024-09-22T03:06:31.679354+0000","last_fullsized":"2024-09-22T03:06:31.679354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.805367+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:18.805367+0000","last_peered":"2024-09-22T03:06:18.805367+0000","last_clean":"2024-09-22T03:06:18.805367+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:18.805367+0000","last_undegraded":"2024-09-22T03:06:18.805367+0000","last_fullsized":"2024-09-22T03:06:18.805367+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":37158912,"num_objects":567,"num_object_clones":0,"num_object_copies":1701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4536,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55742464,"data_stored":111484928,"data_compressed":5753277,"data_compressed_allocated":55742464,"data_compressed_original":111484928,"omap_allocated":0,"internal_metadata":0},"log_size":4520,"ondisk_log_size":4520,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673094,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85712,"kb_used_data":14464,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94286128,"statfs":{"total":96636764160,"available":96548995072,"internally_reserved":0,"allocated":14811136,"data_stored":29204454,"data_compressed":1502815,"data_compressed_allocated":14561280,"data_compressed_original":29122560,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673094,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68212,"kb_used_data":10852,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94303628,"statfs":{"total":96636764160,"available":96566915072,"internally_reserved":0,"allocated":11112448,"data_stored":22274566,"data_compressed":1144745,"data_compressed_allocated":10842112,"data_compressed_original":22175744,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673094,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67376,"kb_used_data":14176,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94304464,"statfs":{"total":96636764160,"available":96567771136,"internally_reserved":0,"allocated":14516224,"data_stored":29082118,"data_compressed":1496022,"data_compressed_allocated":14245888,"data_compressed_original":28983296,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69768,"kb_used_data":12408,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94302072,"statfs":{"total":96636764160,"available":96565321728,"internally_reserved":0,"allocated":12705792,"data_stored":25469427,"data_compressed":1309569,"data_compressed_allocated":12439552,"data_compressed_original":25370624,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13283328,"data_stored":26566656,"data_compressed":1370977,"data_compressed_allocated":13283328,"data_compressed_original":26566656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15171584,"data_stored":30343168,"data_compressed":1565890,"data_compressed_allocated":15171584,"data_compressed_original":30343168,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11567104,"data_stored":23134208,"data_compressed":1193886,"data_compressed_allocated":11567104,"data_compressed_original":23134208,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":31440896,"data_compressed":1622524,"data_compressed_allocated":15720448,"data_compressed_original":31440896,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:34.856 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 16 16 5669 5653 2.76003 2.45312 0.0309362 0.045228 2024-09-22T03:06:35.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:35.489+0000 7fdd84c18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:35.496+0000 7fdd84c18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:35.856 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 17 16 5985 5969 2.74288 2.46875 0.0174817 0.0453693 2024-09-22T03:06:36.856 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 18 16 6345 6329 2.74674 2.8125 0.0480462 0.0454254 2024-09-22T03:06:37.625 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:37.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:37.765+0000 7fcaa7d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:37.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:37.772+0000 7fcaa7d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:37.856 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 19 16 6709 6693 2.75183 2.84375 0.032535 0.0453444 2024-09-22T03:06:38.856 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:06:38.856170+0000 min lat: 0.0090369 max lat: 0.156613 avg lat: 0.0454509 2024-09-22T03:06:38.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:06:38.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 20 16 7043 7027 2.7447 2.60938 0.0725789 0.0454509 2024-09-22T03:06:38.988 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:38.993 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:38.993 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:39.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:39.124+0000 7fb26feb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:39.134+0000 7fb26feb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:39.359 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:06:39.359 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:06:39.378 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-09-22T03:06:38.715058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":51774003,"num_objects":785,"num_object_clones":0,"num_object_copies":2355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":6387,"num_write_kb":51880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6332,"ondisk_log_size":6332,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":294432,"kb_used_data":71904,"kb_used_omap":0,"kb_used_meta":222464,"kb_avail":377192928,"statfs":{"total":386547056640,"available":386245558272,"internally_reserved":0,"allocated":73629696,"data_stored":146998757,"data_compressed":7568574,"data_compressed_allocated":72572928,"data_compressed_original":146620416,"omap_allocated":0,"internal_metadata":227803136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39583744,"num_objects":604,"num_object_clones":0,"num_object_copies":1812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4832,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002110"},"pg_stats":[{"pgid":"4.f","version":"29'335","reported_seq":348,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:36.512394+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:06:36.512394+0000","last_peered":"2024-09-22T03:06:36.512394+0000","last_clean":"2024-09-22T03:06:36.512394+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:06:36.512394+0000","last_undegraded":"2024-09-22T03:06:36.512394+0000","last_fullsized":"2024-09-22T03:06:36.512394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"29'399","reported_seq":412,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:36.661637+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:06:36.661637+0000","last_peered":"2024-09-22T03:06:36.661637+0000","last_clean":"2024-09-22T03:06:36.661637+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:06:36.661637+0000","last_undegraded":"2024-09-22T03:06:36.661637+0000","last_fullsized":"2024-09-22T03:06:36.661637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"29'359","reported_seq":372,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:36.624216+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:06:36.624216+0000","last_peered":"2024-09-22T03:06:36.624216+0000","last_clean":"2024-09-22T03:06:36.624216+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:06:36.624216+0000","last_undegraded":"2024-09-22T03:06:36.624216+0000","last_fullsized":"2024-09-22T03:06:36.624216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'527","reported_seq":540,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:35.856475+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:06:35.856475+0000","last_peered":"2024-09-22T03:06:35.856475+0000","last_clean":"2024-09-22T03:06:35.856475+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:06:35.856475+0000","last_undegraded":"2024-09-22T03:06:35.856475+0000","last_fullsized":"2024-09-22T03:06:35.856475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"29'375","reported_seq":388,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:35.104102+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:06:35.104102+0000","last_peered":"2024-09-22T03:06:35.104102+0000","last_clean":"2024-09-22T03:06:35.104102+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:06:35.104102+0000","last_undegraded":"2024-09-22T03:06:35.104102+0000","last_fullsized":"2024-09-22T03:06:35.104102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"29'367","reported_seq":380,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:36.265744+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:06:36.265744+0000","last_peered":"2024-09-22T03:06:36.265744+0000","last_clean":"2024-09-22T03:06:36.265744+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:06:36.265744+0000","last_undegraded":"2024-09-22T03:06:36.265744+0000","last_fullsized":"2024-09-22T03:06:36.265744+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"29'391","reported_seq":404,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:36.702439+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:06:36.702439+0000","last_peered":"2024-09-22T03:06:36.702439+0000","last_clean":"2024-09-22T03:06:36.702439+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:06:36.702439+0000","last_undegraded":"2024-09-22T03:06:36.702439+0000","last_fullsized":"2024-09-22T03:06:36.702439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"29'375","reported_seq":388,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:36.078345+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:06:36.078345+0000","last_peered":"2024-09-22T03:06:36.078345+0000","last_clean":"2024-09-22T03:06:36.078345+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:06:36.078345+0000","last_undegraded":"2024-09-22T03:06:36.078345+0000","last_fullsized":"2024-09-22T03:06:36.078345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'399","reported_seq":412,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:36.401736+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:06:36.401736+0000","last_peered":"2024-09-22T03:06:36.401736+0000","last_clean":"2024-09-22T03:06:36.401736+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:06:36.401736+0000","last_undegraded":"2024-09-22T03:06:36.401736+0000","last_fullsized":"2024-09-22T03:06:36.401736+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797727+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:18.797727+0000","last_peered":"2024-09-22T03:06:18.797727+0000","last_clean":"2024-09-22T03:06:18.797727+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:18.797727+0000","last_undegraded":"2024-09-22T03:06:18.797727+0000","last_fullsized":"2024-09-22T03:06:18.797727+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'399","reported_seq":412,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:36.686699+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:06:36.686699+0000","last_peered":"2024-09-22T03:06:36.686699+0000","last_clean":"2024-09-22T03:06:36.686699+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:06:36.686699+0000","last_undegraded":"2024-09-22T03:06:36.686699+0000","last_fullsized":"2024-09-22T03:06:36.686699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801165+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:18.801165+0000","last_peered":"2024-09-22T03:06:18.801165+0000","last_clean":"2024-09-22T03:06:18.801165+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:18.801165+0000","last_undegraded":"2024-09-22T03:06:18.801165+0000","last_fullsized":"2024-09-22T03:06:18.801165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"29'407","reported_seq":420,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:36.449032+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:06:36.449032+0000","last_peered":"2024-09-22T03:06:36.449032+0000","last_clean":"2024-09-22T03:06:36.449032+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:06:36.449032+0000","last_undegraded":"2024-09-22T03:06:36.449032+0000","last_fullsized":"2024-09-22T03:06:36.449032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797891+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:18.797891+0000","last_peered":"2024-09-22T03:06:18.797891+0000","last_clean":"2024-09-22T03:06:18.797891+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:18.797891+0000","last_undegraded":"2024-09-22T03:06:18.797891+0000","last_fullsized":"2024-09-22T03:06:18.797891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'423","reported_seq":436,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:35.551073+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:06:35.551073+0000","last_peered":"2024-09-22T03:06:35.551073+0000","last_clean":"2024-09-22T03:06:35.551073+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:06:35.551073+0000","last_undegraded":"2024-09-22T03:06:35.551073+0000","last_fullsized":"2024-09-22T03:06:35.551073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801352+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:18.801352+0000","last_peered":"2024-09-22T03:06:18.801352+0000","last_clean":"2024-09-22T03:06:18.801352+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:18.801352+0000","last_undegraded":"2024-09-22T03:06:18.801352+0000","last_fullsized":"2024-09-22T03:06:18.801352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803187+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:18.803187+0000","last_peered":"2024-09-22T03:06:18.803187+0000","last_clean":"2024-09-22T03:06:18.803187+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:18.803187+0000","last_undegraded":"2024-09-22T03:06:18.803187+0000","last_fullsized":"2024-09-22T03:06:18.803187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'383","reported_seq":396,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:36.600879+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:06:36.600879+0000","last_peered":"2024-09-22T03:06:36.600879+0000","last_clean":"2024-09-22T03:06:36.600879+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:06:36.600879+0000","last_undegraded":"2024-09-22T03:06:36.600879+0000","last_fullsized":"2024-09-22T03:06:36.600879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797975+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:18.797975+0000","last_peered":"2024-09-22T03:06:18.797975+0000","last_clean":"2024-09-22T03:06:18.797975+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:18.797975+0000","last_undegraded":"2024-09-22T03:06:18.797975+0000","last_fullsized":"2024-09-22T03:06:18.797975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'383","reported_seq":396,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:34.717205+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:06:34.717205+0000","last_peered":"2024-09-22T03:06:34.717205+0000","last_clean":"2024-09-22T03:06:34.717205+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:06:34.717205+0000","last_undegraded":"2024-09-22T03:06:34.717205+0000","last_fullsized":"2024-09-22T03:06:34.717205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.802226+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:18.802226+0000","last_peered":"2024-09-22T03:06:18.802226+0000","last_clean":"2024-09-22T03:06:18.802226+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:18.802226+0000","last_undegraded":"2024-09-22T03:06:18.802226+0000","last_fullsized":"2024-09-22T03:06:18.802226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"29'335","reported_seq":348,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:35.619020+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:06:35.619020+0000","last_peered":"2024-09-22T03:06:35.619020+0000","last_clean":"2024-09-22T03:06:35.619020+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:06:35.619020+0000","last_undegraded":"2024-09-22T03:06:35.619020+0000","last_fullsized":"2024-09-22T03:06:35.619020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803519+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:18.803519+0000","last_peered":"2024-09-22T03:06:18.803519+0000","last_clean":"2024-09-22T03:06:18.803519+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:18.803519+0000","last_undegraded":"2024-09-22T03:06:18.803519+0000","last_fullsized":"2024-09-22T03:06:18.803519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'375","reported_seq":388,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:36.451884+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:06:36.451884+0000","last_peered":"2024-09-22T03:06:36.451884+0000","last_clean":"2024-09-22T03:06:36.451884+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:06:36.451884+0000","last_undegraded":"2024-09-22T03:06:36.451884+0000","last_fullsized":"2024-09-22T03:06:36.451884+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.805367+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:18.805367+0000","last_peered":"2024-09-22T03:06:18.805367+0000","last_clean":"2024-09-22T03:06:18.805367+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:18.805367+0000","last_undegraded":"2024-09-22T03:06:18.805367+0000","last_fullsized":"2024-09-22T03:06:18.805367+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":51183616,"num_objects":781,"num_object_clones":0,"num_object_copies":2343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6248,"num_write_kb":49984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":76525568,"data_stored":153051136,"data_compressed":7899579,"data_compressed_allocated":76525568,"data_compressed_original":153051136,"omap_allocated":0,"internal_metadata":0},"log_size":6232,"ondisk_log_size":6232,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673099,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95308,"kb_used_data":19900,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94276532,"statfs":{"total":96636764160,"available":96539168768,"internally_reserved":0,"allocated":20377600,"data_stored":40337382,"data_compressed":2077672,"data_compressed_allocated":20127744,"data_compressed_original":40255488,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673099,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59620,"kb_used_data":14740,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94312220,"statfs":{"total":96636764160,"available":96575713280,"internally_reserved":0,"allocated":15093760,"data_stored":30237190,"data_compressed":1555901,"data_compressed_allocated":14823424,"data_compressed_original":30138368,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673099,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77076,"kb_used_data":19716,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94294764,"statfs":{"total":96636764160,"available":96557838336,"internally_reserved":0,"allocated":20189184,"data_stored":40428038,"data_compressed":2081877,"data_compressed_allocated":19918848,"data_compressed_original":40329216,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62428,"kb_used_data":17548,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94309412,"statfs":{"total":96636764160,"available":96572837888,"internally_reserved":0,"allocated":17969152,"data_stored":35996147,"data_compressed":1853124,"data_compressed_allocated":17702912,"data_compressed_original":35897344,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18579456,"data_stored":37158912,"data_compressed":1917916,"data_compressed_allocated":18579456,"data_compressed_original":37158912,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20992000,"data_stored":41984000,"data_compressed":2166973,"data_compressed_allocated":20992000,"data_compressed_original":41984000,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15695872,"data_stored":31391744,"data_compressed":1620270,"data_compressed_allocated":15695872,"data_compressed_original":31391744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21258240,"data_stored":42516480,"data_compressed":2194420,"data_compressed_allocated":21258240,"data_compressed_original":42516480,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:39.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 21 16 7340 7324 2.72448 2.32031 0.0424141 0.0457849 2024-09-22T03:06:39.917 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:40.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:40.049+0000 7f95fcd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:40.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:40.058+0000 7f95fcd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:40.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 22 16 7665 7649 2.71604 2.53906 0.0163175 0.0459479 2024-09-22T03:06:41.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 23 16 7995 7979 2.71004 2.57812 0.0299558 0.0460586 2024-09-22T03:06:42.187 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:42.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:42.316+0000 7f89f62b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:42.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:42.324+0000 7f89f62b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:42.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 24 16 8313 8297 2.70063 2.48438 0.0489965 0.0462278 2024-09-22T03:06:43.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 25 16 8643 8627 2.69572 2.57812 0.0455533 0.046312 2024-09-22T03:06:44.380 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:44.380 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:44.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:44.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:44.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:44.528+0000 7f16e182c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:44.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:44.542+0000 7f16e182c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:44.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:44.589+0000 7f769b397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:44.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:44.597+0000 7f769b397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:44.824 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:06:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:06:44.844 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-09-22T03:06:44.716322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65077811,"num_objects":989,"num_object_clones":0,"num_object_copies":2967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":8011,"num_write_kb":64872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7956,"ondisk_log_size":7956,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":324268,"kb_used_data":92008,"kb_used_omap":0,"kb_used_meta":232192,"kb_avail":377163092,"statfs":{"total":386547056640,"available":386215006208,"internally_reserved":0,"allocated":94216192,"data_stored":188171749,"data_compressed":9694572,"data_compressed_allocated":93159424,"data_compressed_original":187793408,"omap_allocated":0,"internal_metadata":237764608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27328512,"num_objects":418,"num_object_clones":0,"num_object_copies":1254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3336,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002329"},"pg_stats":[{"pgid":"4.f","version":"29'407","reported_seq":420,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:41.114277+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:06:41.114277+0000","last_peered":"2024-09-22T03:06:41.114277+0000","last_clean":"2024-09-22T03:06:41.114277+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:06:41.114277+0000","last_undegraded":"2024-09-22T03:06:41.114277+0000","last_fullsized":"2024-09-22T03:06:41.114277+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"29'495","reported_seq":508,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:41.690405+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:06:41.690405+0000","last_peered":"2024-09-22T03:06:41.690405+0000","last_clean":"2024-09-22T03:06:41.690405+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:06:41.690405+0000","last_undegraded":"2024-09-22T03:06:41.690405+0000","last_fullsized":"2024-09-22T03:06:41.690405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"29'479","reported_seq":492,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:41.604657+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:06:41.604657+0000","last_peered":"2024-09-22T03:06:41.604657+0000","last_clean":"2024-09-22T03:06:41.604657+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:06:41.604657+0000","last_undegraded":"2024-09-22T03:06:41.604657+0000","last_fullsized":"2024-09-22T03:06:41.604657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'623","reported_seq":636,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:40.854357+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:06:40.854357+0000","last_peered":"2024-09-22T03:06:40.854357+0000","last_clean":"2024-09-22T03:06:40.854357+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:06:40.854357+0000","last_undegraded":"2024-09-22T03:06:40.854357+0000","last_fullsized":"2024-09-22T03:06:40.854357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"29'471","reported_seq":484,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:40.562881+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:06:40.562881+0000","last_peered":"2024-09-22T03:06:40.562881+0000","last_clean":"2024-09-22T03:06:40.562881+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:06:40.562881+0000","last_undegraded":"2024-09-22T03:06:40.562881+0000","last_fullsized":"2024-09-22T03:06:40.562881+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"29'431","reported_seq":444,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:40.899758+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:06:40.899758+0000","last_peered":"2024-09-22T03:06:40.899758+0000","last_clean":"2024-09-22T03:06:40.899758+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:06:40.899758+0000","last_undegraded":"2024-09-22T03:06:40.899758+0000","last_fullsized":"2024-09-22T03:06:40.899758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"29'471","reported_seq":484,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:41.564463+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:06:41.564463+0000","last_peered":"2024-09-22T03:06:41.564463+0000","last_clean":"2024-09-22T03:06:41.564463+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:06:41.564463+0000","last_undegraded":"2024-09-22T03:06:41.564463+0000","last_fullsized":"2024-09-22T03:06:41.564463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"29'495","reported_seq":508,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:41.300897+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:06:41.300897+0000","last_peered":"2024-09-22T03:06:41.300897+0000","last_clean":"2024-09-22T03:06:41.300897+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:06:41.300897+0000","last_undegraded":"2024-09-22T03:06:41.300897+0000","last_fullsized":"2024-09-22T03:06:41.300897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'527","reported_seq":540,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:41.433574+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:06:41.433574+0000","last_peered":"2024-09-22T03:06:41.433574+0000","last_clean":"2024-09-22T03:06:41.433574+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:06:41.433574+0000","last_undegraded":"2024-09-22T03:06:41.433574+0000","last_fullsized":"2024-09-22T03:06:41.433574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797727+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:18.797727+0000","last_peered":"2024-09-22T03:06:18.797727+0000","last_clean":"2024-09-22T03:06:18.797727+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:18.797727+0000","last_undegraded":"2024-09-22T03:06:18.797727+0000","last_fullsized":"2024-09-22T03:06:18.797727+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'489","reported_seq":502,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:41.712504+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:06:41.712504+0000","last_peered":"2024-09-22T03:06:41.712504+0000","last_clean":"2024-09-22T03:06:41.712504+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:06:41.712504+0000","last_undegraded":"2024-09-22T03:06:41.712504+0000","last_fullsized":"2024-09-22T03:06:41.712504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4014080,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":3920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801165+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:18.801165+0000","last_peered":"2024-09-22T03:06:18.801165+0000","last_clean":"2024-09-22T03:06:18.801165+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:18.801165+0000","last_undegraded":"2024-09-22T03:06:18.801165+0000","last_fullsized":"2024-09-22T03:06:18.801165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"29'559","reported_seq":572,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:41.669018+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:06:41.669018+0000","last_peered":"2024-09-22T03:06:41.669018+0000","last_clean":"2024-09-22T03:06:41.669018+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:06:41.669018+0000","last_undegraded":"2024-09-22T03:06:41.669018+0000","last_fullsized":"2024-09-22T03:06:41.669018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797891+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:18.797891+0000","last_peered":"2024-09-22T03:06:18.797891+0000","last_clean":"2024-09-22T03:06:18.797891+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:18.797891+0000","last_undegraded":"2024-09-22T03:06:18.797891+0000","last_fullsized":"2024-09-22T03:06:18.797891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'517","reported_seq":530,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:40.711592+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:06:40.711592+0000","last_peered":"2024-09-22T03:06:40.711592+0000","last_clean":"2024-09-22T03:06:40.711592+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:06:40.711592+0000","last_undegraded":"2024-09-22T03:06:40.711592+0000","last_fullsized":"2024-09-22T03:06:40.711592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4243456,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801352+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:18.801352+0000","last_peered":"2024-09-22T03:06:18.801352+0000","last_clean":"2024-09-22T03:06:18.801352+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:18.801352+0000","last_undegraded":"2024-09-22T03:06:18.801352+0000","last_fullsized":"2024-09-22T03:06:18.801352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803187+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:18.803187+0000","last_peered":"2024-09-22T03:06:18.803187+0000","last_clean":"2024-09-22T03:06:18.803187+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:18.803187+0000","last_undegraded":"2024-09-22T03:06:18.803187+0000","last_fullsized":"2024-09-22T03:06:18.803187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'479","reported_seq":492,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:41.295536+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:06:41.295536+0000","last_peered":"2024-09-22T03:06:41.295536+0000","last_clean":"2024-09-22T03:06:41.295536+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:06:41.295536+0000","last_undegraded":"2024-09-22T03:06:41.295536+0000","last_fullsized":"2024-09-22T03:06:41.295536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797975+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:18.797975+0000","last_peered":"2024-09-22T03:06:18.797975+0000","last_clean":"2024-09-22T03:06:18.797975+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:18.797975+0000","last_undegraded":"2024-09-22T03:06:18.797975+0000","last_fullsized":"2024-09-22T03:06:18.797975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'479","reported_seq":492,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:40.671640+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:06:40.671640+0000","last_peered":"2024-09-22T03:06:40.671640+0000","last_clean":"2024-09-22T03:06:40.671640+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:06:40.671640+0000","last_undegraded":"2024-09-22T03:06:40.671640+0000","last_fullsized":"2024-09-22T03:06:40.671640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.802226+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:18.802226+0000","last_peered":"2024-09-22T03:06:18.802226+0000","last_clean":"2024-09-22T03:06:18.802226+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:18.802226+0000","last_undegraded":"2024-09-22T03:06:18.802226+0000","last_fullsized":"2024-09-22T03:06:18.802226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"29'439","reported_seq":452,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:40.003424+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:06:40.003424+0000","last_peered":"2024-09-22T03:06:40.003424+0000","last_clean":"2024-09-22T03:06:40.003424+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:06:40.003424+0000","last_undegraded":"2024-09-22T03:06:40.003424+0000","last_fullsized":"2024-09-22T03:06:40.003424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803519+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:18.803519+0000","last_peered":"2024-09-22T03:06:18.803519+0000","last_clean":"2024-09-22T03:06:18.803519+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:18.803519+0000","last_undegraded":"2024-09-22T03:06:18.803519+0000","last_fullsized":"2024-09-22T03:06:18.803519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'495","reported_seq":508,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:41.689067+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:06:41.689067+0000","last_peered":"2024-09-22T03:06:41.689067+0000","last_clean":"2024-09-22T03:06:41.689067+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:06:41.689067+0000","last_undegraded":"2024-09-22T03:06:41.689067+0000","last_fullsized":"2024-09-22T03:06:41.689067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.805367+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:18.805367+0000","last_peered":"2024-09-22T03:06:18.805367+0000","last_clean":"2024-09-22T03:06:18.805367+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:18.805367+0000","last_undegraded":"2024-09-22T03:06:18.805367+0000","last_fullsized":"2024-09-22T03:06:18.805367+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":64487424,"num_objects":985,"num_object_clones":0,"num_object_copies":2955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7872,"num_write_kb":62976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":96628736,"data_stored":193257472,"data_compressed":9975663,"data_compressed_allocated":96628736,"data_compressed_original":193257472,"omap_allocated":0,"internal_metadata":0},"log_size":7856,"ondisk_log_size":7856,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673104,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88348,"kb_used_data":25420,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94283492,"statfs":{"total":96636764160,"available":96546295808,"internally_reserved":0,"allocated":26030080,"data_stored":51642342,"data_compressed":2661412,"data_compressed_allocated":25780224,"data_compressed_original":51560448,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673104,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67904,"kb_used_data":18864,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94303936,"statfs":{"total":96636764160,"available":96567230464,"internally_reserved":0,"allocated":19316736,"data_stored":38683142,"data_compressed":1992014,"data_compressed_allocated":19046400,"data_compressed_original":38584320,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673104,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92232,"kb_used_data":25140,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94279608,"statfs":{"total":96636764160,"available":96542318592,"internally_reserved":0,"allocated":25743360,"data_stored":51536390,"data_compressed":2655465,"data_compressed_allocated":25473024,"data_compressed_original":51437568,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705808,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75784,"kb_used_data":22584,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94296056,"statfs":{"total":96636764160,"available":96559161344,"internally_reserved":0,"allocated":23126016,"data_stored":46309875,"data_compressed":2385681,"data_compressed_allocated":22859776,"data_compressed_original":46211072,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23728128,"data_stored":47456256,"data_compressed":2449627,"data_compressed_allocated":23728128,"data_compressed_original":47456256,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26378240,"data_stored":52756480,"data_compressed":2723218,"data_compressed_allocated":26378240,"data_compressed_original":52756480,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19873792,"data_stored":39747584,"data_compressed":2051730,"data_compressed_allocated":19873792,"data_compressed_original":39747584,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26648576,"data_stored":53297152,"data_compressed":2751088,"data_compressed_allocated":26648576,"data_compressed_original":53297152,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:44.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 26 16 8945 8929 2.68277 2.35938 0.0489758 0.0465214 2024-09-22T03:06:45.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 27 16 9246 9230 2.6705 2.35156 0.0669673 0.046752 2024-09-22T03:06:46.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:46.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 28 16 9557 9541 2.66189 2.42969 0.0519439 0.0468699 2024-09-22T03:06:46.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:46.857+0000 7f4b82e58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:46.863+0000 7f4b82e58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:47.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 29 16 9871 9855 2.65469 2.45312 0.0697085 0.0470174 2024-09-22T03:06:48.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 30 16 10197 10181 2.65109 2.54688 0.0662611 0.0470832 2024-09-22T03:06:49.083 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:49.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:49.230+0000 7f504dc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:49.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:49.237+0000 7f504dc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:49.846 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:49.846 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:49.846 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:06:49.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:06:49.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 31 16 10500 10484 2.64193 2.36719 0.0838133 0.0472419 2024-09-22T03:06:49.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:49.974+0000 7f3084b4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:49.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:49.987+0000 7f3084b4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:50.025 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:50.026 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:50.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:06:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:50.182+0000 7fad2134e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:50.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:50.194+0000 7fad2134e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:50.217 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:50.217 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:50.217 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:50.217 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:50.217 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:50.217 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:50.217 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:50.217 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:50.218 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:50.218 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:50.218 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:50.218 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:50.221 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:50.221 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:50.221 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:06:50.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:50.375+0000 7fb2c8afa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:50.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:50.386+0000 7fb2c8afa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:50.407 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:50.407 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:50.407 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:50.407 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:50.407 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:50.407 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:50.407 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:50.407 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:50.407 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:50.407 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:50.408 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:50.408 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:50.410 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:50.410 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:50.410 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:06:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:50.538+0000 7fafc0ece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:50.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:50.548+0000 7fafc0ece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:50.567 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:50.567 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:50.568 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:50.568 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:50.568 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:50.568 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:50.568 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:50.568 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:50.568 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:50.568 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:50.568 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:50.568 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:50.571 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:50.571 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:50.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 32 16 10773 10757 2.62601 2.13281 0.0447717 0.047547 2024-09-22T03:06:51.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:51.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:51.532+0000 7f5b8fe23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:51.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:51.538+0000 7f5b8fe23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:51.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 33 16 11097 11081 2.62313 2.53125 0.0483354 0.0476229 2024-09-22T03:06:52.857 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 34 16 11428 11412 2.62203 2.58594 0.0569937 0.0476251 2024-09-22T03:06:53.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:53.858 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 35 16 11739 11723 2.61653 2.42969 0.0605468 0.0477305 2024-09-22T03:06:53.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:53.864+0000 7f3f082d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:53.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:53.872+0000 7f3f082d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:54.858 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 36 16 12036 12020 2.6083 2.32031 0.0556606 0.0478784 2024-09-22T03:06:55.571 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:55.572 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:55.572 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:06:55.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:06:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:55.686+0000 7f11c022c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:55.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:55.699+0000 7f11c022c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:55.722 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:55.722 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:55.722 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:55.722 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:55.722 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:55.722 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:55.722 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:55.724 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:55.725 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:55.725 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:06:55.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:55.845+0000 7ff857a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:55.858 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 37 16 12320 12304 2.59777 2.21875 0.0467901 0.0480677 2024-09-22T03:06:55.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:55.856+0000 7ff857a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:55.899 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:55.900 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:55.900 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:06:56.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:56.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:56.034+0000 7f774f0d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:56.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:56.054+0000 7f774f0d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:56.081 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:56.081 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:56.082 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:06:56.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:56.174+0000 7f107690e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:56.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:56.184+0000 7f107690e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:56.266+0000 7fbd7662c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:56.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:56.276+0000 7fbd7662c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:06:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:06:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:06:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:06:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:06:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:06:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:06:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:06:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:06:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:06:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:06:56.299 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:56.299 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:56.858 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 38 16 12602 12586 2.58737 2.20312 0.0567781 0.0482713 2024-09-22T03:06:57.858 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 39 16 12916 12900 2.58393 2.45312 0.0373893 0.0483264 2024-09-22T03:06:58.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:58.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:58.517+0000 7ffa89997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:58.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:06:58.523+0000 7ffa89997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:58.858 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:06:58.857786+0000 min lat: 0.0090369 max lat: 0.167454 avg lat: 0.0484005 2024-09-22T03:06:58.858 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:06:58.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 40 16 13229 13213 2.58046 2.44531 0.0359048 0.0484005 2024-09-22T03:06:59.858 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 41 16 13534 13518 2.57563 2.38281 0.0308144 0.0484899 2024-09-22T03:07:00.682 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:00.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:00.830+0000 7f549acd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:00.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:00.836+0000 7f549acd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:00.858 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 42 15 13833 13818 2.5701 2.34375 0.0532898 0.0485938 2024-09-22T03:07:01.300 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:01.301 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:01.301 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:07:01.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:07:01.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:01.429+0000 7f68c1b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:01.441+0000 7f68c1b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.484 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:01.484 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:01.484 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:01.484 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:01.484 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:01.485 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:01.485 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:01.485 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:01.485 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:01.485 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:01.485 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:01.485 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:01.489 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:01.489 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:01.489 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:07:01.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:01.635+0000 7f941fb57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:01.648+0000 7f941fb57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.779 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:01.780 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:01.780 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:01.780 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:01.780 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:01.780 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:01.780 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:01.780 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:01.780 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:01.780 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:01.780 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:01.780 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:01.784 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:01.784 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:01.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:07:01.858 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 43 16 14123 14107 2.56284 2.25781 0.0197852 0.0487093 2024-09-22T03:07:01.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:01.905+0000 7f34b1423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:01.914+0000 7f34b1423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.933 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:01.933 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:01.933 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:01.933 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:01.933 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:01.933 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:01.933 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:01.933 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:01.933 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:01.933 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:01.934 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:01.934 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:01.936 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:01.936 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:01.937 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:07:02.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:02.084+0000 7f505be6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:02.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:02.094+0000 7f505be6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:02.118 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:02.118 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:02.858 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 44 16 14394 14378 2.55271 2.11719 0.0405455 0.0489293 2024-09-22T03:07:03.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:03.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:03.140+0000 7febf38ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:03.146+0000 7febf38ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:03.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 45 16 14684 14668 2.54632 2.26562 0.0521626 0.049057 2024-09-22T03:07:04.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 46 16 14968 14952 2.53919 2.21875 0.064363 0.0491576 2024-09-22T03:07:05.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:05.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:05.433+0000 7f1eb2c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:05.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:05.438+0000 7f1eb2c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:05.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 47 16 15261 15245 2.53387 2.28906 0.0473837 0.0492971 2024-09-22T03:07:06.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 48 16 15530 15514 2.52486 2.10156 0.0700439 0.0494725 2024-09-22T03:07:07.118 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:07.118 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:07.119 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:07:07.119 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:07:07.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:07.255+0000 7f4830b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:07.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:07.265+0000 7f4830b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:07.301 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:07.301 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:07.301 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:07.301 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:07.301 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:07.302 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:07.302 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:07.302 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:07.302 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:07.302 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:07.302 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:07.302 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:07.304 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:07.304 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:07.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:07:07.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:07.417+0000 7f35d4ec3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:07.426+0000 7f35d4ec3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:07.555 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:07.555 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:07.555 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:07.555 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:07.555 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:07.555 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:07.555 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:07.555 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:07.558 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:07.559 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:07.559 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:07:07.589 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:07.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:07.707+0000 7f56490d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:07.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:07.716+0000 7f56490d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:07.733 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:07.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:07.730+0000 7fb3b210e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:07.737 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:07.737 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:07.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:07:07.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:07.736+0000 7fb3b210e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:07.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 49 16 15784 15768 2.51382 1.98438 0.0492739 0.0497046 2024-09-22T03:07:07.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:07.889+0000 7fc71ef57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:07.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:07.901+0000 7fc71ef57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:07.935 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:07.935 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:07.935 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:07.935 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:07.935 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:07.936 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:07.936 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:07.936 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:07.936 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:07.936 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:07.936 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:07.936 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:07.939 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:07.939 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:08.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 50 16 16070 16054 2.50823 2.23438 0.0681509 0.049792 2024-09-22T03:07:09.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 51 16 16369 16353 2.50485 2.33594 0.0405933 0.0498707 2024-09-22T03:07:09.925 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:10.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:10.061+0000 7fb80f997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:10.072+0000 7fb80f997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:10.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 52 16 16649 16633 2.49874 2.1875 0.053162 0.0499914 2024-09-22T03:07:11.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 53 16 16940 16924 2.49449 2.27344 0.0341589 0.0500761 2024-09-22T03:07:12.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:12.436+0000 7f1381d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:12.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:12.443+0000 7f1381d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:12.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 54 16 17226 17210 2.48967 2.23438 0.0828773 0.0501618 2024-09-22T03:07:12.940 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:12.940 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:12.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:13.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:13.077+0000 7ff0f0b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:13.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:13.084+0000 7ff0f0b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:13.385 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:07:13.386 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:07:13.401 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-22T03:07:12.721182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":138412595,"num_objects":2107,"num_object_clones":0,"num_object_copies":6321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":16963,"num_write_kb":136488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16908,"ondisk_log_size":16908,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":489044,"kb_used_data":199888,"kb_used_omap":0,"kb_used_meta":289088,"kb_avail":376998316,"statfs":{"total":386547056640,"available":386046275584,"internally_reserved":0,"allocated":204685312,"data_stored":409109989,"data_compressed":21102879,"data_compressed_allocated":203628544,"data_compressed_original":408731648,"omap_allocated":0,"internal_metadata":296026112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35848192,"num_objects":547,"num_object_clones":0,"num_object_copies":1641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4376,"num_write_kb":35008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002011"},"pg_stats":[{"pgid":"4.f","version":"29'1007","reported_seq":1020,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:11.369544+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:07:11.369544+0000","last_peered":"2024-09-22T03:07:11.369544+0000","last_clean":"2024-09-22T03:07:11.369544+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:07:11.369544+0000","last_undegraded":"2024-09-22T03:07:11.369544+0000","last_fullsized":"2024-09-22T03:07:11.369544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1008,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"29'975","reported_seq":988,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:11.666615+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:07:11.666615+0000","last_peered":"2024-09-22T03:07:11.666615+0000","last_clean":"2024-09-22T03:07:11.666615+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:07:11.666615+0000","last_undegraded":"2024-09-22T03:07:11.666615+0000","last_fullsized":"2024-09-22T03:07:11.666615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"29'1031","reported_seq":1044,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:11.069139+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:07:11.069139+0000","last_peered":"2024-09-22T03:07:11.069139+0000","last_clean":"2024-09-22T03:07:11.069139+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:07:11.069139+0000","last_undegraded":"2024-09-22T03:07:11.069139+0000","last_fullsized":"2024-09-22T03:07:11.069139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'1167","reported_seq":1180,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:11.287637+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:07:11.287637+0000","last_peered":"2024-09-22T03:07:11.287637+0000","last_clean":"2024-09-22T03:07:11.287637+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:07:11.287637+0000","last_undegraded":"2024-09-22T03:07:11.287637+0000","last_fullsized":"2024-09-22T03:07:11.287637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1167,"log_dups_size":0,"ondisk_log_size":1167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"29'1135","reported_seq":1148,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:10.469037+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:07:10.469037+0000","last_peered":"2024-09-22T03:07:10.469037+0000","last_clean":"2024-09-22T03:07:10.469037+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:07:10.469037+0000","last_undegraded":"2024-09-22T03:07:10.469037+0000","last_fullsized":"2024-09-22T03:07:10.469037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1135,"log_dups_size":0,"ondisk_log_size":1135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"29'991","reported_seq":1004,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:11.398763+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:07:11.398763+0000","last_peered":"2024-09-22T03:07:11.398763+0000","last_clean":"2024-09-22T03:07:11.398763+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:07:11.398763+0000","last_undegraded":"2024-09-22T03:07:11.398763+0000","last_fullsized":"2024-09-22T03:07:11.398763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"29'983","reported_seq":996,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:11.711323+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:07:11.711323+0000","last_peered":"2024-09-22T03:07:11.711323+0000","last_clean":"2024-09-22T03:07:11.711323+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:07:11.711323+0000","last_undegraded":"2024-09-22T03:07:11.711323+0000","last_fullsized":"2024-09-22T03:07:11.711323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":984,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"29'983","reported_seq":996,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:11.512571+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:07:11.512571+0000","last_peered":"2024-09-22T03:07:11.512571+0000","last_clean":"2024-09-22T03:07:11.512571+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:07:11.512571+0000","last_undegraded":"2024-09-22T03:07:11.512571+0000","last_fullsized":"2024-09-22T03:07:11.512571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":984,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'999","reported_seq":1012,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:11.523328+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:07:11.523328+0000","last_peered":"2024-09-22T03:07:11.523328+0000","last_clean":"2024-09-22T03:07:11.523328+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:07:11.523328+0000","last_undegraded":"2024-09-22T03:07:11.523328+0000","last_fullsized":"2024-09-22T03:07:11.523328+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1000,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797727+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:18.797727+0000","last_peered":"2024-09-22T03:06:18.797727+0000","last_clean":"2024-09-22T03:06:18.797727+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:18.797727+0000","last_undegraded":"2024-09-22T03:06:18.797727+0000","last_fullsized":"2024-09-22T03:06:18.797727+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'1175","reported_seq":1188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:10.740466+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:07:10.740466+0000","last_peered":"2024-09-22T03:07:10.740466+0000","last_clean":"2024-09-22T03:07:10.740466+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:07:10.740466+0000","last_undegraded":"2024-09-22T03:07:10.740466+0000","last_fullsized":"2024-09-22T03:07:10.740466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801165+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:18.801165+0000","last_peered":"2024-09-22T03:06:18.801165+0000","last_clean":"2024-09-22T03:06:18.801165+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:18.801165+0000","last_undegraded":"2024-09-22T03:06:18.801165+0000","last_fullsized":"2024-09-22T03:06:18.801165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"29'1143","reported_seq":1156,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:11.639468+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:07:11.639468+0000","last_peered":"2024-09-22T03:07:11.639468+0000","last_clean":"2024-09-22T03:07:11.639468+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:07:11.639468+0000","last_undegraded":"2024-09-22T03:07:11.639468+0000","last_fullsized":"2024-09-22T03:07:11.639468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797891+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:18.797891+0000","last_peered":"2024-09-22T03:06:18.797891+0000","last_clean":"2024-09-22T03:06:18.797891+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:18.797891+0000","last_undegraded":"2024-09-22T03:06:18.797891+0000","last_fullsized":"2024-09-22T03:06:18.797891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'1111","reported_seq":1124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:08.605724+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:07:08.605724+0000","last_peered":"2024-09-22T03:07:08.605724+0000","last_clean":"2024-09-22T03:07:08.605724+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:07:08.605724+0000","last_undegraded":"2024-09-22T03:07:08.605724+0000","last_fullsized":"2024-09-22T03:07:08.605724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1111,"log_dups_size":0,"ondisk_log_size":1111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801352+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:18.801352+0000","last_peered":"2024-09-22T03:06:18.801352+0000","last_clean":"2024-09-22T03:06:18.801352+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:18.801352+0000","last_undegraded":"2024-09-22T03:06:18.801352+0000","last_fullsized":"2024-09-22T03:06:18.801352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803187+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:18.803187+0000","last_peered":"2024-09-22T03:06:18.803187+0000","last_clean":"2024-09-22T03:06:18.803187+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:18.803187+0000","last_undegraded":"2024-09-22T03:06:18.803187+0000","last_fullsized":"2024-09-22T03:06:18.803187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'1039","reported_seq":1052,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:11.581715+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:07:11.581715+0000","last_peered":"2024-09-22T03:07:11.581715+0000","last_clean":"2024-09-22T03:07:11.581715+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:07:11.581715+0000","last_undegraded":"2024-09-22T03:07:11.581715+0000","last_fullsized":"2024-09-22T03:07:11.581715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797975+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:18.797975+0000","last_peered":"2024-09-22T03:06:18.797975+0000","last_clean":"2024-09-22T03:06:18.797975+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:18.797975+0000","last_undegraded":"2024-09-22T03:06:18.797975+0000","last_fullsized":"2024-09-22T03:06:18.797975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'1015","reported_seq":1028,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:10.065197+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:07:10.065197+0000","last_peered":"2024-09-22T03:07:10.065197+0000","last_clean":"2024-09-22T03:07:10.065197+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:07:10.065197+0000","last_undegraded":"2024-09-22T03:07:10.065197+0000","last_fullsized":"2024-09-22T03:07:10.065197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1016,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.802226+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:18.802226+0000","last_peered":"2024-09-22T03:06:18.802226+0000","last_clean":"2024-09-22T03:06:18.802226+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:18.802226+0000","last_undegraded":"2024-09-22T03:06:18.802226+0000","last_fullsized":"2024-09-22T03:06:18.802226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"29'1031","reported_seq":1044,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:10.472168+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:07:10.472168+0000","last_peered":"2024-09-22T03:07:10.472168+0000","last_clean":"2024-09-22T03:07:10.472168+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:07:10.472168+0000","last_undegraded":"2024-09-22T03:07:10.472168+0000","last_fullsized":"2024-09-22T03:07:10.472168+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803519+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:18.803519+0000","last_peered":"2024-09-22T03:06:18.803519+0000","last_clean":"2024-09-22T03:06:18.803519+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:18.803519+0000","last_undegraded":"2024-09-22T03:06:18.803519+0000","last_fullsized":"2024-09-22T03:06:18.803519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'1023","reported_seq":1036,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:11.170320+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:07:11.170320+0000","last_peered":"2024-09-22T03:07:11.170320+0000","last_clean":"2024-09-22T03:07:11.170320+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:07:11.170320+0000","last_undegraded":"2024-09-22T03:07:11.170320+0000","last_fullsized":"2024-09-22T03:07:11.170320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.805367+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:18.805367+0000","last_peered":"2024-09-22T03:06:18.805367+0000","last_clean":"2024-09-22T03:06:18.805367+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:18.805367+0000","last_undegraded":"2024-09-22T03:06:18.805367+0000","last_fullsized":"2024-09-22T03:06:18.805367+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":137822208,"num_objects":2103,"num_object_clones":0,"num_object_copies":6309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16824,"num_write_kb":134592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":206675968,"data_stored":413351936,"data_compressed":21340401,"data_compressed_allocated":206675968,"data_compressed_original":413351936,"omap_allocated":0,"internal_metadata":0},"log_size":16808,"ondisk_log_size":16808,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673134,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129412,"kb_used_data":54004,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94242428,"statfs":{"total":96636764160,"available":96504246272,"internally_reserved":0,"allocated":55300096,"data_stored":110182374,"data_compressed":5684169,"data_compressed_allocated":55050240,"data_compressed_original":110100480,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673134,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117864,"kb_used_data":42452,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94253976,"statfs":{"total":96636764160,"available":96516071424,"internally_reserved":0,"allocated":43470848,"data_stored":86991366,"data_compressed":4486444,"data_compressed_allocated":43200512,"data_compressed_original":86892544,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673134,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129340,"kb_used_data":53932,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94242500,"statfs":{"total":96636764160,"available":96504320000,"internally_reserved":0,"allocated":55226368,"data_stored":110502406,"data_compressed":5700218,"data_compressed_allocated":54956032,"data_compressed_original":110403584,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705838,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112428,"kb_used_data":49500,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94259412,"statfs":{"total":96636764160,"available":96521637888,"internally_reserved":0,"allocated":50688000,"data_stored":101433843,"data_compressed":5232048,"data_compressed_allocated":50421760,"data_compressed_original":101335040,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":51224576,"data_stored":102449152,"data_compressed":5289226,"data_compressed_allocated":51224576,"data_compressed_original":102449152,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55779328,"data_stored":111558656,"data_compressed":5759511,"data_compressed_allocated":55779328,"data_compressed_original":111558656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":43802624,"data_stored":87605248,"data_compressed":4522895,"data_compressed_allocated":43802624,"data_compressed_original":87605248,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":55869440,"data_stored":111738880,"data_compressed":5768769,"data_compressed_allocated":55869440,"data_compressed_original":111738880,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:13.859 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 55 16 17496 17480 2.48275 2.10938 0.0306042 0.0503059 2024-09-22T03:07:14.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:14.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:14.761+0000 7f4dd2797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:14.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:14.767+0000 7f4dd2797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:14.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 56 16 17757 17741 2.47482 2.03906 0.114366 0.0504486 2024-09-22T03:07:15.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 57 16 18049 18033 2.47142 2.28125 0.0713221 0.0505393 2024-09-22T03:07:16.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 58 16 18318 18302 2.46504 2.10156 0.0714218 0.0506742 2024-09-22T03:07:16.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:17.027+0000 7fdd79e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:17.032+0000 7fdd79e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:17.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 59 16 18578 18562 2.45769 2.03125 0.0803543 0.0508322 2024-09-22T03:07:18.403 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:18.403 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:18.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:18.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:18.556+0000 7f2dcd8ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:18.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:18.568+0000 7f2dcd8ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:18.815 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:07:18.815 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:07:18.836 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-09-22T03:07:18.722358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":149488179,"num_objects":2276,"num_object_clones":0,"num_object_copies":6828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":18315,"num_write_kb":147304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18260,"ondisk_log_size":18260,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":485244,"kb_used_data":216888,"kb_used_omap":0,"kb_used_meta":268288,"kb_avail":377002116,"statfs":{"total":386547056640,"available":386050166784,"internally_reserved":0,"allocated":222093312,"data_stored":443925989,"data_compressed":22900629,"data_compressed_allocated":221036544,"data_compressed_original":443547648,"omap_allocated":0,"internal_metadata":274726912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31301632,"num_objects":477,"num_object_clones":0,"num_object_copies":1431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3821,"num_write_kb":30568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002259"},"pg_stats":[{"pgid":"4.f","version":"29'1103","reported_seq":1116,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:16.235781+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:07:16.235781+0000","last_peered":"2024-09-22T03:07:16.235781+0000","last_clean":"2024-09-22T03:07:16.235781+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:07:16.235781+0000","last_undegraded":"2024-09-22T03:07:16.235781+0000","last_fullsized":"2024-09-22T03:07:16.235781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1103,"log_dups_size":0,"ondisk_log_size":1103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1104,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"29'1023","reported_seq":1036,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:16.088415+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:07:16.088415+0000","last_peered":"2024-09-22T03:07:16.088415+0000","last_clean":"2024-09-22T03:07:16.088415+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:07:16.088415+0000","last_undegraded":"2024-09-22T03:07:16.088415+0000","last_fullsized":"2024-09-22T03:07:16.088415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"29'1095","reported_seq":1108,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:15.568885+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:07:15.568885+0000","last_peered":"2024-09-22T03:07:15.568885+0000","last_clean":"2024-09-22T03:07:15.568885+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:07:15.568885+0000","last_undegraded":"2024-09-22T03:07:15.568885+0000","last_fullsized":"2024-09-22T03:07:15.568885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1096,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'1199","reported_seq":1212,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:15.001781+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:07:15.001781+0000","last_peered":"2024-09-22T03:07:15.001781+0000","last_clean":"2024-09-22T03:07:15.001781+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:07:15.001781+0000","last_undegraded":"2024-09-22T03:07:15.001781+0000","last_fullsized":"2024-09-22T03:07:15.001781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"29'1263","reported_seq":1276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:15.537818+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:07:15.537818+0000","last_peered":"2024-09-22T03:07:15.537818+0000","last_clean":"2024-09-22T03:07:15.537818+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:07:15.537818+0000","last_undegraded":"2024-09-22T03:07:15.537818+0000","last_fullsized":"2024-09-22T03:07:15.537818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1263,"log_dups_size":0,"ondisk_log_size":1263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1264,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"29'1103","reported_seq":1116,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:15.783682+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:07:15.783682+0000","last_peered":"2024-09-22T03:07:15.783682+0000","last_clean":"2024-09-22T03:07:15.783682+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:07:15.783682+0000","last_undegraded":"2024-09-22T03:07:15.783682+0000","last_fullsized":"2024-09-22T03:07:15.783682+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1103,"log_dups_size":0,"ondisk_log_size":1103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1104,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"29'1079","reported_seq":1092,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:16.661414+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:07:16.661414+0000","last_peered":"2024-09-22T03:07:16.661414+0000","last_clean":"2024-09-22T03:07:16.661414+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:07:16.661414+0000","last_undegraded":"2024-09-22T03:07:16.661414+0000","last_fullsized":"2024-09-22T03:07:16.661414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"29'1071","reported_seq":1084,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:16.219363+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:07:16.219363+0000","last_peered":"2024-09-22T03:07:16.219363+0000","last_clean":"2024-09-22T03:07:16.219363+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:07:16.219363+0000","last_undegraded":"2024-09-22T03:07:16.219363+0000","last_fullsized":"2024-09-22T03:07:16.219363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'1087","reported_seq":1100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:16.485483+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:07:16.485483+0000","last_peered":"2024-09-22T03:07:16.485483+0000","last_clean":"2024-09-22T03:07:16.485483+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:07:16.485483+0000","last_undegraded":"2024-09-22T03:07:16.485483+0000","last_fullsized":"2024-09-22T03:07:16.485483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1087,"log_dups_size":0,"ondisk_log_size":1087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912896,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1088,"num_write_kb":8704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797727+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:18.797727+0000","last_peered":"2024-09-22T03:06:18.797727+0000","last_clean":"2024-09-22T03:06:18.797727+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:18.797727+0000","last_undegraded":"2024-09-22T03:06:18.797727+0000","last_fullsized":"2024-09-22T03:06:18.797727+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'1255","reported_seq":1268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:15.748625+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:07:15.748625+0000","last_peered":"2024-09-22T03:07:15.748625+0000","last_clean":"2024-09-22T03:07:15.748625+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:07:15.748625+0000","last_undegraded":"2024-09-22T03:07:15.748625+0000","last_fullsized":"2024-09-22T03:07:15.748625+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1256,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801165+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:18.801165+0000","last_peered":"2024-09-22T03:06:18.801165+0000","last_clean":"2024-09-22T03:06:18.801165+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:18.801165+0000","last_undegraded":"2024-09-22T03:06:18.801165+0000","last_fullsized":"2024-09-22T03:06:18.801165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"29'1215","reported_seq":1228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:16.394139+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:07:16.394139+0000","last_peered":"2024-09-22T03:07:16.394139+0000","last_clean":"2024-09-22T03:07:16.394139+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:07:16.394139+0000","last_undegraded":"2024-09-22T03:07:16.394139+0000","last_fullsized":"2024-09-22T03:07:16.394139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797891+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:18.797891+0000","last_peered":"2024-09-22T03:06:18.797891+0000","last_clean":"2024-09-22T03:06:18.797891+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:18.797891+0000","last_undegraded":"2024-09-22T03:06:18.797891+0000","last_fullsized":"2024-09-22T03:06:18.797891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'1199","reported_seq":1212,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:15.649497+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:07:15.649497+0000","last_peered":"2024-09-22T03:07:15.649497+0000","last_clean":"2024-09-22T03:07:15.649497+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:07:15.649497+0000","last_undegraded":"2024-09-22T03:07:15.649497+0000","last_fullsized":"2024-09-22T03:07:15.649497+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801352+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:18.801352+0000","last_peered":"2024-09-22T03:06:18.801352+0000","last_clean":"2024-09-22T03:06:18.801352+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:18.801352+0000","last_undegraded":"2024-09-22T03:06:18.801352+0000","last_fullsized":"2024-09-22T03:06:18.801352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803187+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:18.803187+0000","last_peered":"2024-09-22T03:06:18.803187+0000","last_clean":"2024-09-22T03:06:18.803187+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:18.803187+0000","last_undegraded":"2024-09-22T03:06:18.803187+0000","last_fullsized":"2024-09-22T03:06:18.803187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'1143","reported_seq":1156,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:15.963334+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:07:15.963334+0000","last_peered":"2024-09-22T03:07:15.963334+0000","last_clean":"2024-09-22T03:07:15.963334+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:07:15.963334+0000","last_undegraded":"2024-09-22T03:07:15.963334+0000","last_fullsized":"2024-09-22T03:07:15.963334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797975+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:18.797975+0000","last_peered":"2024-09-22T03:06:18.797975+0000","last_clean":"2024-09-22T03:06:18.797975+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:18.797975+0000","last_undegraded":"2024-09-22T03:06:18.797975+0000","last_fullsized":"2024-09-22T03:06:18.797975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'1087","reported_seq":1100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:15.584980+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:07:15.584980+0000","last_peered":"2024-09-22T03:07:15.584980+0000","last_clean":"2024-09-22T03:07:15.584980+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:07:15.584980+0000","last_undegraded":"2024-09-22T03:07:15.584980+0000","last_fullsized":"2024-09-22T03:07:15.584980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1087,"log_dups_size":0,"ondisk_log_size":1087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912896,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1088,"num_write_kb":8704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.802226+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:18.802226+0000","last_peered":"2024-09-22T03:06:18.802226+0000","last_clean":"2024-09-22T03:06:18.802226+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:18.802226+0000","last_undegraded":"2024-09-22T03:06:18.802226+0000","last_fullsized":"2024-09-22T03:06:18.802226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"29'1127","reported_seq":1140,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:15.082302+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:07:15.082302+0000","last_peered":"2024-09-22T03:07:15.082302+0000","last_clean":"2024-09-22T03:07:15.082302+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:07:15.082302+0000","last_undegraded":"2024-09-22T03:07:15.082302+0000","last_fullsized":"2024-09-22T03:07:15.082302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803519+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:18.803519+0000","last_peered":"2024-09-22T03:06:18.803519+0000","last_clean":"2024-09-22T03:06:18.803519+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:18.803519+0000","last_undegraded":"2024-09-22T03:06:18.803519+0000","last_fullsized":"2024-09-22T03:06:18.803519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'1111","reported_seq":1124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:16.536185+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:07:16.536185+0000","last_peered":"2024-09-22T03:07:16.536185+0000","last_clean":"2024-09-22T03:07:16.536185+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:07:16.536185+0000","last_undegraded":"2024-09-22T03:07:16.536185+0000","last_fullsized":"2024-09-22T03:07:16.536185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1111,"log_dups_size":0,"ondisk_log_size":1111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.805367+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:18.805367+0000","last_peered":"2024-09-22T03:06:18.805367+0000","last_clean":"2024-09-22T03:06:18.805367+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:18.805367+0000","last_undegraded":"2024-09-22T03:06:18.805367+0000","last_fullsized":"2024-09-22T03:06:18.805367+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":148897792,"num_objects":2272,"num_object_clones":0,"num_object_copies":6816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18176,"num_write_kb":145408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":223653888,"data_stored":447307776,"data_compressed":23093736,"data_compressed_allocated":223653888,"data_compressed_original":447307776,"omap_allocated":0,"internal_metadata":0},"log_size":18160,"ondisk_log_size":18160,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121420,"kb_used_data":58488,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94250420,"statfs":{"total":96636764160,"available":96512430080,"internally_reserved":0,"allocated":59891712,"data_stored":119365606,"data_compressed":6158352,"data_compressed_allocated":59641856,"data_compressed_original":119283712,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121452,"kb_used_data":46044,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94250388,"statfs":{"total":96636764160,"available":96512397312,"internally_reserved":0,"allocated":47149056,"data_stored":94347782,"data_compressed":4866298,"data_compressed_allocated":46878720,"data_compressed_original":94248960,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121488,"kb_used_data":58560,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94250352,"statfs":{"total":96636764160,"available":96512360448,"internally_reserved":0,"allocated":59965440,"data_stored":119980550,"data_compressed":6189629,"data_compressed_allocated":59695104,"data_compressed_original":119881728,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120884,"kb_used_data":53796,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94250956,"statfs":{"total":96636764160,"available":96512978944,"internally_reserved":0,"allocated":55087104,"data_stored":110232051,"data_compressed":5686350,"data_compressed_allocated":54820864,"data_compressed_original":110133248,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":55545856,"data_stored":111091712,"data_compressed":5735491,"data_compressed_allocated":55545856,"data_compressed_original":111091712,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60399616,"data_stored":120799232,"data_compressed":6236655,"data_compressed_allocated":60399616,"data_compressed_original":120799232,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47415296,"data_stored":94830592,"data_compressed":4895981,"data_compressed_allocated":47415296,"data_compressed_original":94830592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":60293120,"data_stored":120586240,"data_compressed":6225609,"data_compressed_allocated":60293120,"data_compressed_original":120586240,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:18.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:07:18.859517+0000 min lat: 0.0090369 max lat: 0.190786 avg lat: 0.0509299 2024-09-22T03:07:18.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:07:18.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 60 16 18855 18839 2.45279 2.16406 0.0440268 0.0509299 2024-09-22T03:07:19.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:19.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:19.291+0000 7f1ec9397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:19.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:19.297+0000 7f1ec9397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:19.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 61 16 19108 19092 2.44498 1.97656 0.0640053 0.0510923 2024-09-22T03:07:20.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 62 16 19372 19356 2.43881 2.0625 0.0521626 0.0512309 2024-09-22T03:07:21.523 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:21.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:21.641+0000 7f00b4d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:21.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:21.648+0000 7f00b4d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:21.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 63 16 19626 19610 2.43159 1.98438 0.060497 0.0513727 2024-09-22T03:07:22.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 64 16 19884 19868 2.42509 2.01562 0.0474274 0.0515171 2024-09-22T03:07:23.839 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:23.839 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:23.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:23.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 65 16 20158 20142 2.42071 2.14062 0.067038 0.0515943 2024-09-22T03:07:23.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:23.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:23.979+0000 7f5c11157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:23.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:23.989+0000 7f5c11157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:24.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:24.007+0000 7f5924597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:24.013+0000 7f5924597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:07:24.238 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:07:24.258 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-22T03:07:22.723059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":160637491,"num_objects":2448,"num_object_clones":0,"num_object_copies":7344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":19676,"num_write_kb":158192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19621,"ondisk_log_size":19621,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":505376,"kb_used_data":232860,"kb_used_omap":0,"kb_used_meta":272448,"kb_avail":376981984,"statfs":{"total":386547056640,"available":386029551616,"internally_reserved":0,"allocated":238448640,"data_stored":476636645,"data_compressed":24589668,"data_compressed_allocated":237391872,"data_compressed_original":476258304,"omap_allocated":0,"internal_metadata":278986752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33579008,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4099,"num_write_kb":32792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002208"},"pg_stats":[{"pgid":"4.f","version":"29'1159","reported_seq":1172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:20.821618+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:07:20.821618+0000","last_peered":"2024-09-22T03:07:20.821618+0000","last_clean":"2024-09-22T03:07:20.821618+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:07:20.821618+0000","last_undegraded":"2024-09-22T03:07:20.821618+0000","last_fullsized":"2024-09-22T03:07:20.821618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":9280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"29'1175","reported_seq":1188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.291475+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:07:21.291475+0000","last_peered":"2024-09-22T03:07:21.291475+0000","last_clean":"2024-09-22T03:07:21.291475+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:07:21.291475+0000","last_undegraded":"2024-09-22T03:07:21.291475+0000","last_fullsized":"2024-09-22T03:07:21.291475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"29'1151","reported_seq":1164,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.578587+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:07:21.578587+0000","last_peered":"2024-09-22T03:07:21.578587+0000","last_clean":"2024-09-22T03:07:21.578587+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:07:21.578587+0000","last_undegraded":"2024-09-22T03:07:21.578587+0000","last_fullsized":"2024-09-22T03:07:21.578587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'1279","reported_seq":1292,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.621241+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:07:21.621241+0000","last_peered":"2024-09-22T03:07:21.621241+0000","last_clean":"2024-09-22T03:07:21.621241+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:07:21.621241+0000","last_undegraded":"2024-09-22T03:07:21.621241+0000","last_fullsized":"2024-09-22T03:07:21.621241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":160,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1280,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"29'1375","reported_seq":1388,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:20.637500+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:07:20.637500+0000","last_peered":"2024-09-22T03:07:20.637500+0000","last_clean":"2024-09-22T03:07:20.637500+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:07:20.637500+0000","last_undegraded":"2024-09-22T03:07:20.637500+0000","last_fullsized":"2024-09-22T03:07:20.637500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1376,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"29'1191","reported_seq":1204,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.088465+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:07:21.088465+0000","last_peered":"2024-09-22T03:07:21.088465+0000","last_clean":"2024-09-22T03:07:21.088465+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:07:21.088465+0000","last_undegraded":"2024-09-22T03:07:21.088465+0000","last_fullsized":"2024-09-22T03:07:21.088465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"29'1207","reported_seq":1220,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.518431+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:07:21.518431+0000","last_peered":"2024-09-22T03:07:21.518431+0000","last_clean":"2024-09-22T03:07:21.518431+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:07:21.518431+0000","last_undegraded":"2024-09-22T03:07:21.518431+0000","last_fullsized":"2024-09-22T03:07:21.518431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1207,"log_dups_size":0,"ondisk_log_size":1207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"29'1159","reported_seq":1172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.688384+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:07:21.688384+0000","last_peered":"2024-09-22T03:07:21.688384+0000","last_clean":"2024-09-22T03:07:21.688384+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:07:21.688384+0000","last_undegraded":"2024-09-22T03:07:21.688384+0000","last_fullsized":"2024-09-22T03:07:21.688384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":9280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'1167","reported_seq":1180,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.689126+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:07:21.689126+0000","last_peered":"2024-09-22T03:07:21.689126+0000","last_clean":"2024-09-22T03:07:21.689126+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:07:21.689126+0000","last_undegraded":"2024-09-22T03:07:21.689126+0000","last_fullsized":"2024-09-22T03:07:21.689126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1167,"log_dups_size":0,"ondisk_log_size":1167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797727+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:18.797727+0000","last_peered":"2024-09-22T03:06:18.797727+0000","last_clean":"2024-09-22T03:06:18.797727+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:18.797727+0000","last_undegraded":"2024-09-22T03:06:18.797727+0000","last_fullsized":"2024-09-22T03:06:18.797727+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'1327","reported_seq":1340,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:20.754859+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:07:20.754859+0000","last_peered":"2024-09-22T03:07:20.754859+0000","last_clean":"2024-09-22T03:07:20.754859+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:07:20.754859+0000","last_undegraded":"2024-09-22T03:07:20.754859+0000","last_fullsized":"2024-09-22T03:07:20.754859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801165+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:18.801165+0000","last_peered":"2024-09-22T03:06:18.801165+0000","last_clean":"2024-09-22T03:06:18.801165+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:18.801165+0000","last_undegraded":"2024-09-22T03:06:18.801165+0000","last_fullsized":"2024-09-22T03:06:18.801165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"29'1256","reported_seq":1269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.641404+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:07:21.641404+0000","last_peered":"2024-09-22T03:07:21.641404+0000","last_clean":"2024-09-22T03:07:21.641404+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:07:21.641404+0000","last_undegraded":"2024-09-22T03:07:21.641404+0000","last_fullsized":"2024-09-22T03:07:21.641404+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1256,"log_dups_size":0,"ondisk_log_size":1256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10297344,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":10056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797891+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:18.797891+0000","last_peered":"2024-09-22T03:06:18.797891+0000","last_clean":"2024-09-22T03:06:18.797891+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:18.797891+0000","last_undegraded":"2024-09-22T03:06:18.797891+0000","last_fullsized":"2024-09-22T03:06:18.797891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'1279","reported_seq":1292,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:20.681105+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:07:20.681105+0000","last_peered":"2024-09-22T03:07:20.681105+0000","last_clean":"2024-09-22T03:07:20.681105+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:07:20.681105+0000","last_undegraded":"2024-09-22T03:07:20.681105+0000","last_fullsized":"2024-09-22T03:07:20.681105+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":160,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1280,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801352+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:18.801352+0000","last_peered":"2024-09-22T03:06:18.801352+0000","last_clean":"2024-09-22T03:06:18.801352+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:18.801352+0000","last_undegraded":"2024-09-22T03:06:18.801352+0000","last_fullsized":"2024-09-22T03:06:18.801352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803187+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:18.803187+0000","last_peered":"2024-09-22T03:06:18.803187+0000","last_clean":"2024-09-22T03:06:18.803187+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:18.803187+0000","last_undegraded":"2024-09-22T03:06:18.803187+0000","last_fullsized":"2024-09-22T03:06:18.803187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'1223","reported_seq":1236,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.376246+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:07:21.376246+0000","last_peered":"2024-09-22T03:07:21.376246+0000","last_clean":"2024-09-22T03:07:21.376246+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:07:21.376246+0000","last_undegraded":"2024-09-22T03:07:21.376246+0000","last_fullsized":"2024-09-22T03:07:21.376246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1223,"log_dups_size":0,"ondisk_log_size":1223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797975+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:18.797975+0000","last_peered":"2024-09-22T03:06:18.797975+0000","last_clean":"2024-09-22T03:06:18.797975+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:18.797975+0000","last_undegraded":"2024-09-22T03:06:18.797975+0000","last_fullsized":"2024-09-22T03:06:18.797975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'1145","reported_seq":1158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:20.712025+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:07:20.712025+0000","last_peered":"2024-09-22T03:07:20.712025+0000","last_clean":"2024-09-22T03:07:20.712025+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:07:20.712025+0000","last_undegraded":"2024-09-22T03:07:20.712025+0000","last_fullsized":"2024-09-22T03:07:20.712025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1145,"log_dups_size":0,"ondisk_log_size":1145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9388032,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":9168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.802226+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:18.802226+0000","last_peered":"2024-09-22T03:06:18.802226+0000","last_clean":"2024-09-22T03:06:18.802226+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:18.802226+0000","last_undegraded":"2024-09-22T03:06:18.802226+0000","last_fullsized":"2024-09-22T03:06:18.802226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"29'1239","reported_seq":1252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:20.096924+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:07:20.096924+0000","last_peered":"2024-09-22T03:07:20.096924+0000","last_clean":"2024-09-22T03:07:20.096924+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:07:20.096924+0000","last_undegraded":"2024-09-22T03:07:20.096924+0000","last_fullsized":"2024-09-22T03:07:20.096924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1239,"log_dups_size":0,"ondisk_log_size":1239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803519+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:18.803519+0000","last_peered":"2024-09-22T03:06:18.803519+0000","last_clean":"2024-09-22T03:06:18.803519+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:18.803519+0000","last_undegraded":"2024-09-22T03:06:18.803519+0000","last_fullsized":"2024-09-22T03:06:18.803519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'1189","reported_seq":1202,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.726787+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:07:21.726787+0000","last_peered":"2024-09-22T03:07:21.726787+0000","last_clean":"2024-09-22T03:07:21.726787+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:07:21.726787+0000","last_undegraded":"2024-09-22T03:07:21.726787+0000","last_fullsized":"2024-09-22T03:07:21.726787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1189,"log_dups_size":0,"ondisk_log_size":1189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9748480,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":9520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.805367+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:18.805367+0000","last_peered":"2024-09-22T03:06:18.805367+0000","last_clean":"2024-09-22T03:06:18.805367+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:18.805367+0000","last_undegraded":"2024-09-22T03:06:18.805367+0000","last_fullsized":"2024-09-22T03:06:18.805367+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":160047104,"num_objects":2444,"num_object_clones":0,"num_object_copies":7332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19537,"num_write_kb":156296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":239812608,"data_stored":479625216,"data_compressed":24762471,"data_compressed_allocated":239812608,"data_compressed_original":479625216,"omap_allocated":0,"internal_metadata":0},"log_size":19521,"ondisk_log_size":19521,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129776,"kb_used_data":62688,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94242064,"statfs":{"total":96636764160,"available":96503873536,"internally_reserved":0,"allocated":64192512,"data_stored":127967206,"data_compressed":6602502,"data_compressed_allocated":63942656,"data_compressed_original":127885312,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112272,"kb_used_data":49340,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94259568,"statfs":{"total":96636764160,"available":96521797632,"internally_reserved":0,"allocated":50524160,"data_stored":101097990,"data_compressed":5214850,"data_compressed_allocated":50253824,"data_compressed_original":100999168,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134292,"kb_used_data":63044,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94237548,"statfs":{"total":96636764160,"available":96499249152,"internally_reserved":0,"allocated":64557056,"data_stored":129163782,"data_compressed":6663812,"data_compressed_allocated":64286720,"data_compressed_original":129064960,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129036,"kb_used_data":57788,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94242804,"statfs":{"total":96636764160,"available":96504631296,"internally_reserved":0,"allocated":59174912,"data_stored":118407667,"data_compressed":6108504,"data_compressed_allocated":58908672,"data_compressed_original":118308864,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":59396096,"data_stored":118792192,"data_compressed":6133111,"data_compressed_allocated":59396096,"data_compressed_original":118792192,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65007616,"data_stored":130015232,"data_compressed":6712530,"data_compressed_allocated":65007616,"data_compressed_original":130015232,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":50704384,"data_stored":101408768,"data_compressed":5235650,"data_compressed_allocated":50704384,"data_compressed_original":101408768,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64704512,"data_stored":129409024,"data_compressed":6681180,"data_compressed_allocated":64704512,"data_compressed_original":129409024,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:24.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 66 16 20397 20381 2.41232 1.86719 0.0955912 0.0517745 2024-09-22T03:07:25.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 67 16 20682 20666 2.40955 2.22656 0.0528345 0.051851 2024-09-22T03:07:26.239 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:26.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:26.375+0000 7f002f597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:26.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:26.381+0000 7f002f597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:26.860 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 68 15 20951 20936 2.40513 2.10938 0.0325408 0.0519595 2024-09-22T03:07:27.861 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 69 16 21209 21193 2.39937 2.00781 0.0453204 0.0520739 2024-09-22T03:07:28.555 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:28.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:28.717+0000 7f62a2cd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:28.726+0000 7f62a2cd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:28.861 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 70 16 21467 21451 2.39389 2.01562 0.0303634 0.0521859 2024-09-22T03:07:29.260 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:29.260 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:29.261 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:07:29.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:07:29.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:29.380+0000 7f82c4397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:29.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:29.390+0000 7f82c4397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:29.414 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:29.414 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:29.415 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:29.416 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:29.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:07:29.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:29.551+0000 7fb7fae2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:29.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:29.561+0000 7fb7fae2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:29.614 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:29.614 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:29.614 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:29.614 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:29.614 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:29.615 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:29.615 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:29.615 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:29.615 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:29.615 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:29.615 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:29.617 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:29.617 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:29.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:07:29.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:29.735+0000 7f21ceeb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:29.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:29.746+0000 7f21ceeb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:29.763 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:29.766 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:29.767 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:29.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:07:29.861 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 71 16 21698 21682 2.38559 1.80469 0.0498422 0.0523616 2024-09-22T03:07:29.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:29.903+0000 7f943846c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:29.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:29.916+0000 7f943846c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:29.938 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:29.938 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:29.938 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:29.938 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:29.938 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:29.938 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:29.938 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:29.938 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:29.938 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:29.938 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:29.938 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:29.942 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:29.942 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:30.861 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 72 16 21952 21936 2.38001 1.98438 0.102135 0.0524989 2024-09-22T03:07:30.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:31.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:31.085+0000 7ff4dca2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:31.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:31.091+0000 7ff4dca2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:31.861 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 73 16 22196 22180 2.37352 1.90625 0.0296101 0.0526253 2024-09-22T03:07:32.861 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 74 16 22449 22433 2.36815 1.97656 0.0577233 0.0527561 2024-09-22T03:07:33.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:33.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:33.436+0000 7fdeb050e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:33.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:33.441+0000 7fdeb050e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:33.861 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 75 16 22712 22696 2.36397 2.05469 0.0634337 0.0528537 2024-09-22T03:07:34.861 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 76 16 22968 22952 2.35918 2 0.0633909 0.0529508 2024-09-22T03:07:34.943 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:34.943 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:34.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:35.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:35.060+0000 7fe644e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:35.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:35.070+0000 7fe644e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:07:35.316 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:07:35.330 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-22T03:07:34.725157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181813811,"num_objects":2770,"num_object_clones":0,"num_object_copies":8310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":22261,"num_write_kb":178872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22206,"ondisk_log_size":22206,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":552892,"kb_used_data":263740,"kb_used_omap":0,"kb_used_meta":289088,"kb_avail":376934468,"statfs":{"total":386547056640,"available":385980895232,"internally_reserved":0,"allocated":270069760,"data_stored":539878885,"data_compressed":27855228,"data_compressed_allocated":269012992,"data_compressed_original":539500544,"omap_allocated":0,"internal_metadata":296026112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21176320,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2585,"num_write_kb":20680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002097"},"pg_stats":[{"pgid":"4.f","version":"29'1295","reported_seq":1308,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:30.897895+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:07:30.897895+0000","last_peered":"2024-09-22T03:07:30.897895+0000","last_clean":"2024-09-22T03:07:30.897895+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:07:30.897895+0000","last_undegraded":"2024-09-22T03:07:30.897895+0000","last_fullsized":"2024-09-22T03:07:30.897895+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10616832,"num_objects":162,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"29'1311","reported_seq":1324,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:31.116805+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:07:31.116805+0000","last_peered":"2024-09-22T03:07:31.116805+0000","last_clean":"2024-09-22T03:07:31.116805+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:07:31.116805+0000","last_undegraded":"2024-09-22T03:07:31.116805+0000","last_fullsized":"2024-09-22T03:07:31.116805+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1311,"log_dups_size":0,"ondisk_log_size":1311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"29'1383","reported_seq":1396,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:31.599499+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:07:31.599499+0000","last_peered":"2024-09-22T03:07:31.599499+0000","last_clean":"2024-09-22T03:07:31.599499+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:07:31.599499+0000","last_undegraded":"2024-09-22T03:07:31.599499+0000","last_fullsized":"2024-09-22T03:07:31.599499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1383,"log_dups_size":0,"ondisk_log_size":1383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11337728,"num_objects":173,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":11072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'1423","reported_seq":1436,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:31.064706+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:07:31.064706+0000","last_peered":"2024-09-22T03:07:31.064706+0000","last_clean":"2024-09-22T03:07:31.064706+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:07:31.064706+0000","last_undegraded":"2024-09-22T03:07:31.064706+0000","last_fullsized":"2024-09-22T03:07:31.064706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11665408,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1424,"num_write_kb":11392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"29'1551","reported_seq":1564,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:30.216818+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:07:30.216818+0000","last_peered":"2024-09-22T03:07:30.216818+0000","last_clean":"2024-09-22T03:07:30.216818+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:07:30.216818+0000","last_undegraded":"2024-09-22T03:07:30.216818+0000","last_fullsized":"2024-09-22T03:07:30.216818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1551,"log_dups_size":0,"ondisk_log_size":1551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1552,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"29'1327","reported_seq":1340,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:30.758818+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:07:30.758818+0000","last_peered":"2024-09-22T03:07:30.758818+0000","last_clean":"2024-09-22T03:07:30.758818+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:07:30.758818+0000","last_undegraded":"2024-09-22T03:07:30.758818+0000","last_fullsized":"2024-09-22T03:07:30.758818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"29'1367","reported_seq":1380,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:31.457084+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:07:31.457084+0000","last_peered":"2024-09-22T03:07:31.457084+0000","last_clean":"2024-09-22T03:07:31.457084+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:07:31.457084+0000","last_undegraded":"2024-09-22T03:07:31.457084+0000","last_fullsized":"2024-09-22T03:07:31.457084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1367,"log_dups_size":0,"ondisk_log_size":1367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1368,"num_write_kb":10944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"29'1391","reported_seq":1404,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:31.695163+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:07:31.695163+0000","last_peered":"2024-09-22T03:07:31.695163+0000","last_clean":"2024-09-22T03:07:31.695163+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:07:31.695163+0000","last_undegraded":"2024-09-22T03:07:31.695163+0000","last_fullsized":"2024-09-22T03:07:31.695163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1392,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'1311","reported_seq":1324,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:29.904162+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:07:29.904162+0000","last_peered":"2024-09-22T03:07:29.904162+0000","last_clean":"2024-09-22T03:07:29.904162+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:07:29.904162+0000","last_undegraded":"2024-09-22T03:07:29.904162+0000","last_fullsized":"2024-09-22T03:07:29.904162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1311,"log_dups_size":0,"ondisk_log_size":1311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797727+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:18.797727+0000","last_peered":"2024-09-22T03:06:18.797727+0000","last_clean":"2024-09-22T03:06:18.797727+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:18.797727+0000","last_undegraded":"2024-09-22T03:06:18.797727+0000","last_fullsized":"2024-09-22T03:06:18.797727+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'1431","reported_seq":1444,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:31.716871+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:07:31.716871+0000","last_peered":"2024-09-22T03:07:31.716871+0000","last_clean":"2024-09-22T03:07:31.716871+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:07:31.716871+0000","last_undegraded":"2024-09-22T03:07:31.716871+0000","last_fullsized":"2024-09-22T03:07:31.716871+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1431,"log_dups_size":0,"ondisk_log_size":1431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1432,"num_write_kb":11456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801165+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:18.801165+0000","last_peered":"2024-09-22T03:06:18.801165+0000","last_clean":"2024-09-22T03:06:18.801165+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:18.801165+0000","last_undegraded":"2024-09-22T03:06:18.801165+0000","last_fullsized":"2024-09-22T03:06:18.801165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"29'1391","reported_seq":1404,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:31.673025+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:07:31.673025+0000","last_peered":"2024-09-22T03:07:31.673025+0000","last_clean":"2024-09-22T03:07:31.673025+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:07:31.673025+0000","last_undegraded":"2024-09-22T03:07:31.673025+0000","last_fullsized":"2024-09-22T03:07:31.673025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1392,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797891+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:18.797891+0000","last_peered":"2024-09-22T03:06:18.797891+0000","last_clean":"2024-09-22T03:06:18.797891+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:18.797891+0000","last_undegraded":"2024-09-22T03:06:18.797891+0000","last_fullsized":"2024-09-22T03:06:18.797891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'1415","reported_seq":1428,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:29.661564+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:07:29.661564+0000","last_peered":"2024-09-22T03:07:29.661564+0000","last_clean":"2024-09-22T03:07:29.661564+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:07:29.661564+0000","last_undegraded":"2024-09-22T03:07:29.661564+0000","last_fullsized":"2024-09-22T03:07:29.661564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1416,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801352+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:18.801352+0000","last_peered":"2024-09-22T03:06:18.801352+0000","last_clean":"2024-09-22T03:06:18.801352+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:18.801352+0000","last_undegraded":"2024-09-22T03:06:18.801352+0000","last_fullsized":"2024-09-22T03:06:18.801352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803187+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:18.803187+0000","last_peered":"2024-09-22T03:06:18.803187+0000","last_clean":"2024-09-22T03:06:18.803187+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:18.803187+0000","last_undegraded":"2024-09-22T03:06:18.803187+0000","last_fullsized":"2024-09-22T03:06:18.803187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'1375","reported_seq":1388,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:31.512167+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:07:31.512167+0000","last_peered":"2024-09-22T03:07:31.512167+0000","last_clean":"2024-09-22T03:07:31.512167+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:07:31.512167+0000","last_undegraded":"2024-09-22T03:07:31.512167+0000","last_fullsized":"2024-09-22T03:07:31.512167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1376,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797975+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:18.797975+0000","last_peered":"2024-09-22T03:06:18.797975+0000","last_clean":"2024-09-22T03:06:18.797975+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:18.797975+0000","last_undegraded":"2024-09-22T03:06:18.797975+0000","last_fullsized":"2024-09-22T03:06:18.797975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'1311","reported_seq":1324,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:30.648649+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:07:30.648649+0000","last_peered":"2024-09-22T03:07:30.648649+0000","last_clean":"2024-09-22T03:07:30.648649+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:07:30.648649+0000","last_undegraded":"2024-09-22T03:07:30.648649+0000","last_fullsized":"2024-09-22T03:07:30.648649+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1311,"log_dups_size":0,"ondisk_log_size":1311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.802226+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:18.802226+0000","last_peered":"2024-09-22T03:06:18.802226+0000","last_clean":"2024-09-22T03:06:18.802226+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:18.802226+0000","last_undegraded":"2024-09-22T03:06:18.802226+0000","last_fullsized":"2024-09-22T03:06:18.802226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"29'1423","reported_seq":1436,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:30.486834+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:07:30.486834+0000","last_peered":"2024-09-22T03:07:30.486834+0000","last_clean":"2024-09-22T03:07:30.486834+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:07:30.486834+0000","last_undegraded":"2024-09-22T03:07:30.486834+0000","last_fullsized":"2024-09-22T03:07:30.486834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11665408,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1424,"num_write_kb":11392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803519+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:18.803519+0000","last_peered":"2024-09-22T03:06:18.803519+0000","last_clean":"2024-09-22T03:06:18.803519+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:18.803519+0000","last_undegraded":"2024-09-22T03:06:18.803519+0000","last_fullsized":"2024-09-22T03:06:18.803519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'1401","reported_seq":1414,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:31.723624+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:07:31.723624+0000","last_peered":"2024-09-22T03:07:31.723624+0000","last_clean":"2024-09-22T03:07:31.723624+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:07:31.723624+0000","last_undegraded":"2024-09-22T03:07:31.723624+0000","last_fullsized":"2024-09-22T03:07:31.723624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1401,"log_dups_size":0,"ondisk_log_size":1401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11485184,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1402,"num_write_kb":11216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.805367+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:18.805367+0000","last_peered":"2024-09-22T03:06:18.805367+0000","last_clean":"2024-09-22T03:06:18.805367+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:18.805367+0000","last_undegraded":"2024-09-22T03:06:18.805367+0000","last_fullsized":"2024-09-22T03:06:18.805367+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":181223424,"num_objects":2766,"num_object_clones":0,"num_object_copies":8298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22122,"num_write_kb":176976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271572992,"data_stored":543145984,"data_compressed":28042413,"data_compressed_allocated":271572992,"data_compressed_original":543145984,"omap_allocated":0,"internal_metadata":0},"log_size":22106,"ondisk_log_size":22106,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673154,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":146092,"kb_used_data":70684,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94225748,"statfs":{"total":96636764160,"available":96487165952,"internally_reserved":0,"allocated":72380416,"data_stored":144343014,"data_compressed":7448079,"data_compressed_allocated":72130560,"data_compressed_original":144261120,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673154,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126824,"kb_used_data":55576,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94245016,"statfs":{"total":96636764160,"available":96506896384,"internally_reserved":0,"allocated":56909824,"data_stored":113869318,"data_compressed":5874307,"data_compressed_allocated":56639488,"data_compressed_original":113770496,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673154,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151380,"kb_used_data":71812,"kb_used_omap":0,"kb_used_meta":79552,"kb_avail":94220460,"statfs":{"total":96636764160,"available":96481751040,"internally_reserved":0,"allocated":73535488,"data_stored":147120646,"data_compressed":7591028,"data_compressed_allocated":73265152,"data_compressed_original":147021824,"omap_allocated":0,"internal_metadata":81461248},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705858,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128596,"kb_used_data":65668,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94243244,"statfs":{"total":96636764160,"available":96505081856,"internally_reserved":0,"allocated":67244032,"data_stored":134545907,"data_compressed":6941814,"data_compressed_allocated":66977792,"data_compressed_original":134447104,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":67653632,"data_stored":135307264,"data_compressed":6985879,"data_compressed_allocated":67653632,"data_compressed_original":135307264,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73928704,"data_stored":147857408,"data_compressed":7633824,"data_compressed_allocated":73928704,"data_compressed_original":147857408,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57212928,"data_stored":114425856,"data_compressed":5907797,"data_compressed_allocated":57212928,"data_compressed_original":114425856,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":72777728,"data_stored":145555456,"data_compressed":7514913,"data_compressed_allocated":72777728,"data_compressed_original":145555456,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:35.718 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:35.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:35.855+0000 7f0066b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:35.861 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 77 16 23205 23189 2.35259 1.85156 0.0743723 0.0530924 2024-09-22T03:07:35.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:35.864+0000 7f0066b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:36.861 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 78 16 23435 23419 2.34546 1.79688 0.115668 0.0532461 2024-09-22T03:07:37.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 79 16 23686 23670 2.34059 1.96094 0.100956 0.0533726 2024-09-22T03:07:38.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:38.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:38.193+0000 7fea25b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:38.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:38.200+0000 7fea25b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:38.861 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:07:38.861125+0000 min lat: 0.0090369 max lat: 0.205224 avg lat: 0.0534878 2024-09-22T03:07:38.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:07:38.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 80 16 23937 23921 2.33584 1.96094 0.0831368 0.0534878 2024-09-22T03:07:39.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 81 16 24195 24179 2.33189 2.01562 0.0531494 0.0535811 2024-09-22T03:07:40.332 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:40.333 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:40.333 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:07:40.333 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:07:40.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:40.492+0000 7fdde5317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:40.503+0000 7fdde5317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:40.534 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:40.536 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:40.536 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:40.536 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:40.536 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:40.536 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:40.536 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:40.536 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:40.536 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:40.536 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:40.537 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:40.537 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:40.541 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:40.541 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:40.541 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:07:40.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:40.670+0000 7f8a5b997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:40.677+0000 7f8a5b997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:40.738+0000 7f0fc7f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:40.748+0000 7f0fc7f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.783 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:40.783 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:40.784 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:40.784 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:40.784 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:40.784 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:40.784 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:40.784 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:40.785 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:40.785 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:40.785 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:40.785 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:40.787 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:40.787 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:40.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:07:40.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 82 16 24448 24432 2.32755 1.97656 0.030849 0.0536778 2024-09-22T03:07:40.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:40.927+0000 7fa6a2397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:40.937+0000 7fa6a2397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.982 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:40.983 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:40.983 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:40.983 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:40.983 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:40.983 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:40.983 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:40.983 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:40.983 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:40.983 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:40.983 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:40.983 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:40.986 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:40.986 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:40.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:07:41.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:41.155+0000 7f9fce0d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:41.163+0000 7f9fce0d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:41.233 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:41.234 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:41.234 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:41.234 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:41.234 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:41.234 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:41.234 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:41.234 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:41.234 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:41.234 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:41.234 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:41.234 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:41.237 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:41.237 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:41.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 83 16 24693 24677 2.32257 1.91406 0.0727749 0.0537854 2024-09-22T03:07:42.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 84 16 24931 24915 2.31705 1.85938 0.116613 0.0538825 2024-09-22T03:07:42.902 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:43.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:43.034+0000 7f8817d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:43.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:43.039+0000 7f8817d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:43.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 85 16 25191 25175 2.31369 2.03125 0.0649254 0.0539976 2024-09-22T03:07:44.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 86 16 25442 25426 2.30958 1.96094 0.0410086 0.054081 2024-09-22T03:07:45.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:45.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:45.317+0000 7f8eb2a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:45.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:45.324+0000 7f8eb2a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:45.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 87 16 25678 25662 2.30423 1.84375 0.030182 0.0542289 2024-09-22T03:07:46.238 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:46.239 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:07:46.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:46.356+0000 7fe13606c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:46.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:46.368+0000 7fe13606c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:46.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 88 16 25917 25901 2.29926 1.86719 0.0346465 0.0543452 2024-09-22T03:07:47.428 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:07:47.452 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:07:47.518 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:47.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:47.593+0000 7fe66ec6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:47.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:47.608+0000 7fe66ec6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:47.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:47.670+0000 7fc2e762c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:47.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:47.676+0000 7fc2e762c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:47.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 89 16 26129 26113 2.29203 1.65625 0.113786 0.054517 2024-09-22T03:07:48.435 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:07:48.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:07:48.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:48.639+0000 7fc205997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:48.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:48.652+0000 7fc205997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:48.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 90 14 26349 26335 2.28584 1.73438 0.0335332 0.0546536 2024-09-22T03:07:49.444 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:07:49.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:07:49.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:49.563+0000 7f91d7eb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:49.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:49.572+0000 7f91d7eb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:49.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:49.862 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total time run: 90.0407 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total writes made: 26349 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Write size: 8192 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object size: 65536 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Bandwidth (MB/sec): 2.2862 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Bandwidth: 0.332588 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max bandwidth (MB/sec): 3.17969 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min bandwidth (MB/sec): 1.65625 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average IOPS: 292 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev IOPS: 42.5712 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max IOPS: 407 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min IOPS: 212 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average Latency(s): 0.0546602 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Latency(s): 0.0247679 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max latency(s): 0.213004 2024-09-22T03:07:49.863 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min latency(s): 0.0090369 2024-09-22T03:07:49.880 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:07:50.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:50.004+0000 7f19a3ace640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:50.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:50.011+0000 7f19a3ace640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:50.453 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:07:50.474 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:07:50.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:50.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:50.622+0000 7fdc4ad57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:50.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:50.635+0000 7fdc4ad57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:50.991 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:07:50.992 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:07:51.010 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-22T03:07:50.727831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":212009523,"num_objects":3232,"num_object_clones":0,"num_object_copies":9696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":25947,"num_write_kb":208360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25892,"ondisk_log_size":25892,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":603336,"kb_used_data":308616,"kb_used_omap":0,"kb_used_meta":294656,"kb_avail":376884024,"statfs":{"total":386547056640,"available":385929240576,"internally_reserved":0,"allocated":316022784,"data_stored":631784933,"data_compressed":32600862,"data_compressed_allocated":314966016,"data_compressed_original":631406592,"omap_allocated":0,"internal_metadata":301727744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4734976,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000546"},"pg_stats":[{"pgid":"4.f","version":"29'1471","reported_seq":1484,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.423753+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:07:46.423753+0000","last_peered":"2024-09-22T03:07:46.423753+0000","last_clean":"2024-09-22T03:07:46.423753+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:07:46.423753+0000","last_undegraded":"2024-09-22T03:07:46.423753+0000","last_fullsized":"2024-09-22T03:07:46.423753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1471,"log_dups_size":0,"ondisk_log_size":1471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"29'1543","reported_seq":1556,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.276221+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:07:46.276221+0000","last_peered":"2024-09-22T03:07:46.276221+0000","last_clean":"2024-09-22T03:07:46.276221+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:07:46.276221+0000","last_undegraded":"2024-09-22T03:07:46.276221+0000","last_fullsized":"2024-09-22T03:07:46.276221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1543,"log_dups_size":0,"ondisk_log_size":1543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12648448,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1544,"num_write_kb":12352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"29'1543","reported_seq":1556,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.119425+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:07:45.119425+0000","last_peered":"2024-09-22T03:07:45.119425+0000","last_clean":"2024-09-22T03:07:45.119425+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:07:45.119425+0000","last_undegraded":"2024-09-22T03:07:45.119425+0000","last_fullsized":"2024-09-22T03:07:45.119425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1543,"log_dups_size":0,"ondisk_log_size":1543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12648448,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1544,"num_write_kb":12352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'1749","reported_seq":1762,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.717882+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:07:46.717882+0000","last_peered":"2024-09-22T03:07:46.717882+0000","last_clean":"2024-09-22T03:07:46.717882+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:07:46.717882+0000","last_undegraded":"2024-09-22T03:07:46.717882+0000","last_fullsized":"2024-09-22T03:07:46.717882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14336000,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1750,"num_write_kb":14000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"29'1834","reported_seq":1847,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.711228+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:07:45.711228+0000","last_peered":"2024-09-22T03:07:45.711228+0000","last_clean":"2024-09-22T03:07:45.711228+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:07:45.711228+0000","last_undegraded":"2024-09-22T03:07:45.711228+0000","last_fullsized":"2024-09-22T03:07:45.711228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1834,"log_dups_size":0,"ondisk_log_size":1834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15032320,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1835,"num_write_kb":14680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"29'1575","reported_seq":1588,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.681622+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:07:46.681622+0000","last_peered":"2024-09-22T03:07:46.681622+0000","last_clean":"2024-09-22T03:07:46.681622+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:07:46.681622+0000","last_undegraded":"2024-09-22T03:07:46.681622+0000","last_fullsized":"2024-09-22T03:07:46.681622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1576,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"29'1535","reported_seq":1548,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.941619+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:07:45.941619+0000","last_peered":"2024-09-22T03:07:45.941619+0000","last_clean":"2024-09-22T03:07:45.941619+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:07:45.941619+0000","last_undegraded":"2024-09-22T03:07:45.941619+0000","last_fullsized":"2024-09-22T03:07:45.941619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1536,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"29'1573","reported_seq":1586,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.722314+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:07:46.722314+0000","last_peered":"2024-09-22T03:07:46.722314+0000","last_clean":"2024-09-22T03:07:46.722314+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:07:46.722314+0000","last_undegraded":"2024-09-22T03:07:46.722314+0000","last_fullsized":"2024-09-22T03:07:46.722314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1573,"log_dups_size":0,"ondisk_log_size":1573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12894208,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1574,"num_write_kb":12592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'1487","reported_seq":1500,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.484087+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:07:46.484087+0000","last_peered":"2024-09-22T03:07:46.484087+0000","last_clean":"2024-09-22T03:07:46.484087+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:07:46.484087+0000","last_undegraded":"2024-09-22T03:07:46.484087+0000","last_fullsized":"2024-09-22T03:07:46.484087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1488,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797727+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:18.797727+0000","last_peered":"2024-09-22T03:06:18.797727+0000","last_clean":"2024-09-22T03:06:18.797727+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:18.797727+0000","last_undegraded":"2024-09-22T03:06:18.797727+0000","last_fullsized":"2024-09-22T03:06:18.797727+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'1695","reported_seq":1708,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.683740+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:07:45.683740+0000","last_peered":"2024-09-22T03:07:45.683740+0000","last_clean":"2024-09-22T03:07:45.683740+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:07:45.683740+0000","last_undegraded":"2024-09-22T03:07:45.683740+0000","last_fullsized":"2024-09-22T03:07:45.683740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1696,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801165+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:18.801165+0000","last_peered":"2024-09-22T03:06:18.801165+0000","last_clean":"2024-09-22T03:06:18.801165+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:18.801165+0000","last_undegraded":"2024-09-22T03:06:18.801165+0000","last_fullsized":"2024-09-22T03:06:18.801165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"29'1672","reported_seq":1685,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.109938+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:07:46.109938+0000","last_peered":"2024-09-22T03:07:46.109938+0000","last_clean":"2024-09-22T03:07:46.109938+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:07:46.109938+0000","last_undegraded":"2024-09-22T03:07:46.109938+0000","last_fullsized":"2024-09-22T03:07:46.109938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1672,"log_dups_size":0,"ondisk_log_size":1672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13705216,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1673,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797891+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:18.797891+0000","last_peered":"2024-09-22T03:06:18.797891+0000","last_clean":"2024-09-22T03:06:18.797891+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:18.797891+0000","last_undegraded":"2024-09-22T03:06:18.797891+0000","last_fullsized":"2024-09-22T03:06:18.797891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'1639","reported_seq":1652,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.032583+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:07:45.032583+0000","last_peered":"2024-09-22T03:07:45.032583+0000","last_clean":"2024-09-22T03:07:45.032583+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:07:45.032583+0000","last_undegraded":"2024-09-22T03:07:45.032583+0000","last_fullsized":"2024-09-22T03:07:45.032583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1639,"log_dups_size":0,"ondisk_log_size":1639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1640,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801352+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:18.801352+0000","last_peered":"2024-09-22T03:06:18.801352+0000","last_clean":"2024-09-22T03:06:18.801352+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:18.801352+0000","last_undegraded":"2024-09-22T03:06:18.801352+0000","last_fullsized":"2024-09-22T03:06:18.801352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803187+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:18.803187+0000","last_peered":"2024-09-22T03:06:18.803187+0000","last_clean":"2024-09-22T03:06:18.803187+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:18.803187+0000","last_undegraded":"2024-09-22T03:06:18.803187+0000","last_fullsized":"2024-09-22T03:06:18.803187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'1639","reported_seq":1652,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.616865+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:07:46.616865+0000","last_peered":"2024-09-22T03:07:46.616865+0000","last_clean":"2024-09-22T03:07:46.616865+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:07:46.616865+0000","last_undegraded":"2024-09-22T03:07:46.616865+0000","last_fullsized":"2024-09-22T03:07:46.616865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1639,"log_dups_size":0,"ondisk_log_size":1639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1640,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797975+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:18.797975+0000","last_peered":"2024-09-22T03:06:18.797975+0000","last_clean":"2024-09-22T03:06:18.797975+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:18.797975+0000","last_undegraded":"2024-09-22T03:06:18.797975+0000","last_fullsized":"2024-09-22T03:06:18.797975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'1503","reported_seq":1516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.677775+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:07:45.677775+0000","last_peered":"2024-09-22T03:07:45.677775+0000","last_clean":"2024-09-22T03:07:45.677775+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:07:45.677775+0000","last_undegraded":"2024-09-22T03:07:45.677775+0000","last_fullsized":"2024-09-22T03:07:45.677775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12320768,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1504,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.802226+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:18.802226+0000","last_peered":"2024-09-22T03:06:18.802226+0000","last_clean":"2024-09-22T03:06:18.802226+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:18.802226+0000","last_undegraded":"2024-09-22T03:06:18.802226+0000","last_fullsized":"2024-09-22T03:06:18.802226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"29'1615","reported_seq":1628,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.269126+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:07:45.269126+0000","last_peered":"2024-09-22T03:07:45.269126+0000","last_clean":"2024-09-22T03:07:45.269126+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:07:45.269126+0000","last_undegraded":"2024-09-22T03:07:45.269126+0000","last_fullsized":"2024-09-22T03:07:45.269126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1616,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803519+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:18.803519+0000","last_peered":"2024-09-22T03:06:18.803519+0000","last_clean":"2024-09-22T03:06:18.803519+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:18.803519+0000","last_undegraded":"2024-09-22T03:06:18.803519+0000","last_fullsized":"2024-09-22T03:06:18.803519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'1719","reported_seq":1732,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.200725+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:07:46.200725+0000","last_peered":"2024-09-22T03:07:46.200725+0000","last_clean":"2024-09-22T03:07:46.200725+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:07:46.200725+0000","last_undegraded":"2024-09-22T03:07:46.200725+0000","last_fullsized":"2024-09-22T03:07:46.200725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1720,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.805367+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:18.805367+0000","last_peered":"2024-09-22T03:06:18.805367+0000","last_clean":"2024-09-22T03:06:18.805367+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:18.805367+0000","last_undegraded":"2024-09-22T03:06:18.805367+0000","last_fullsized":"2024-09-22T03:06:18.805367+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":211419136,"num_objects":3228,"num_object_clones":0,"num_object_copies":9684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25808,"num_write_kb":206464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":317218816,"data_stored":634437632,"data_compressed":32756322,"data_compressed_allocated":317218816,"data_compressed_original":634437632,"omap_allocated":0,"internal_metadata":0},"log_size":25792,"ondisk_log_size":25792,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":172232,"kb_used_data":82936,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94199608,"statfs":{"total":96636764160,"available":96460398592,"internally_reserved":0,"allocated":84926464,"data_stored":169435110,"data_compressed":8743728,"data_compressed_allocated":84676608,"data_compressed_original":169353216,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128256,"kb_used_data":65328,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94243584,"statfs":{"total":96636764160,"available":96505430016,"internally_reserved":0,"allocated":66895872,"data_stored":133841414,"data_compressed":6905580,"data_compressed_allocated":66625536,"data_compressed_original":133742592,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":155160,"kb_used_data":83912,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94216680,"statfs":{"total":96636764160,"available":96477880320,"internally_reserved":0,"allocated":85925888,"data_stored":171901446,"data_compressed":8870602,"data_compressed_allocated":85655552,"data_compressed_original":171802624,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":147688,"kb_used_data":76440,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94224152,"statfs":{"total":96636764160,"available":96485531648,"internally_reserved":0,"allocated":78274560,"data_stored":156606963,"data_compressed":8080952,"data_compressed_allocated":78008320,"data_compressed_original":156508160,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":78475264,"data_stored":156950528,"data_compressed":8103444,"data_compressed_allocated":78475264,"data_compressed_original":156950528,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86294528,"data_stored":172589056,"data_compressed":8910860,"data_compressed_allocated":86294528,"data_compressed_original":172589056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":67014656,"data_stored":134029312,"data_compressed":6920035,"data_compressed_allocated":67014656,"data_compressed_original":134029312,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":85434368,"data_stored":170868736,"data_compressed":8821983,"data_compressed_allocated":85434368,"data_compressed_original":170868736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:51.011 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:51.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:51.171+0000 7f7afdb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:51.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:51.183+0000 7f7afdb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:07:51.510 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:07:51.526 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-22T03:07:50.727831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":212009523,"num_objects":3232,"num_object_clones":0,"num_object_copies":9696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":25947,"num_write_kb":208360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25892,"ondisk_log_size":25892,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":603336,"kb_used_data":308616,"kb_used_omap":0,"kb_used_meta":294656,"kb_avail":376884024,"statfs":{"total":386547056640,"available":385929240576,"internally_reserved":0,"allocated":316022784,"data_stored":631784933,"data_compressed":32600862,"data_compressed_allocated":314966016,"data_compressed_original":631406592,"omap_allocated":0,"internal_metadata":301727744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4734976,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000546"},"pg_stats":[{"pgid":"4.f","version":"29'1471","reported_seq":1484,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.423753+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:07:46.423753+0000","last_peered":"2024-09-22T03:07:46.423753+0000","last_clean":"2024-09-22T03:07:46.423753+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:07:46.423753+0000","last_undegraded":"2024-09-22T03:07:46.423753+0000","last_fullsized":"2024-09-22T03:07:46.423753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1471,"log_dups_size":0,"ondisk_log_size":1471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"29'1543","reported_seq":1556,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.276221+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:07:46.276221+0000","last_peered":"2024-09-22T03:07:46.276221+0000","last_clean":"2024-09-22T03:07:46.276221+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:07:46.276221+0000","last_undegraded":"2024-09-22T03:07:46.276221+0000","last_fullsized":"2024-09-22T03:07:46.276221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1543,"log_dups_size":0,"ondisk_log_size":1543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12648448,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1544,"num_write_kb":12352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"29'1543","reported_seq":1556,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.119425+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:07:45.119425+0000","last_peered":"2024-09-22T03:07:45.119425+0000","last_clean":"2024-09-22T03:07:45.119425+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:07:45.119425+0000","last_undegraded":"2024-09-22T03:07:45.119425+0000","last_fullsized":"2024-09-22T03:07:45.119425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1543,"log_dups_size":0,"ondisk_log_size":1543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12648448,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1544,"num_write_kb":12352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'1749","reported_seq":1762,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.717882+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:07:46.717882+0000","last_peered":"2024-09-22T03:07:46.717882+0000","last_clean":"2024-09-22T03:07:46.717882+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:07:46.717882+0000","last_undegraded":"2024-09-22T03:07:46.717882+0000","last_fullsized":"2024-09-22T03:07:46.717882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14336000,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1750,"num_write_kb":14000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"29'1834","reported_seq":1847,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.711228+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:07:45.711228+0000","last_peered":"2024-09-22T03:07:45.711228+0000","last_clean":"2024-09-22T03:07:45.711228+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:07:45.711228+0000","last_undegraded":"2024-09-22T03:07:45.711228+0000","last_fullsized":"2024-09-22T03:07:45.711228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1834,"log_dups_size":0,"ondisk_log_size":1834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15032320,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1835,"num_write_kb":14680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"29'1575","reported_seq":1588,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.681622+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:07:46.681622+0000","last_peered":"2024-09-22T03:07:46.681622+0000","last_clean":"2024-09-22T03:07:46.681622+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:07:46.681622+0000","last_undegraded":"2024-09-22T03:07:46.681622+0000","last_fullsized":"2024-09-22T03:07:46.681622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1576,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"29'1535","reported_seq":1548,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.941619+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:07:45.941619+0000","last_peered":"2024-09-22T03:07:45.941619+0000","last_clean":"2024-09-22T03:07:45.941619+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:07:45.941619+0000","last_undegraded":"2024-09-22T03:07:45.941619+0000","last_fullsized":"2024-09-22T03:07:45.941619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1536,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"29'1573","reported_seq":1586,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.722314+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:07:46.722314+0000","last_peered":"2024-09-22T03:07:46.722314+0000","last_clean":"2024-09-22T03:07:46.722314+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:07:46.722314+0000","last_undegraded":"2024-09-22T03:07:46.722314+0000","last_fullsized":"2024-09-22T03:07:46.722314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1573,"log_dups_size":0,"ondisk_log_size":1573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12894208,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1574,"num_write_kb":12592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'1487","reported_seq":1500,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.484087+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:07:46.484087+0000","last_peered":"2024-09-22T03:07:46.484087+0000","last_clean":"2024-09-22T03:07:46.484087+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:07:46.484087+0000","last_undegraded":"2024-09-22T03:07:46.484087+0000","last_fullsized":"2024-09-22T03:07:46.484087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1488,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797727+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:06:18.797727+0000","last_peered":"2024-09-22T03:06:18.797727+0000","last_clean":"2024-09-22T03:06:18.797727+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:06:18.797727+0000","last_undegraded":"2024-09-22T03:06:18.797727+0000","last_fullsized":"2024-09-22T03:06:18.797727+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'1695","reported_seq":1708,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.683740+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:07:45.683740+0000","last_peered":"2024-09-22T03:07:45.683740+0000","last_clean":"2024-09-22T03:07:45.683740+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:07:45.683740+0000","last_undegraded":"2024-09-22T03:07:45.683740+0000","last_fullsized":"2024-09-22T03:07:45.683740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1696,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801165+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:06:18.801165+0000","last_peered":"2024-09-22T03:06:18.801165+0000","last_clean":"2024-09-22T03:06:18.801165+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:06:18.801165+0000","last_undegraded":"2024-09-22T03:06:18.801165+0000","last_fullsized":"2024-09-22T03:06:18.801165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"29'1672","reported_seq":1685,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.109938+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:07:46.109938+0000","last_peered":"2024-09-22T03:07:46.109938+0000","last_clean":"2024-09-22T03:07:46.109938+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:07:46.109938+0000","last_undegraded":"2024-09-22T03:07:46.109938+0000","last_fullsized":"2024-09-22T03:07:46.109938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1672,"log_dups_size":0,"ondisk_log_size":1672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13705216,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1673,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797891+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:06:18.797891+0000","last_peered":"2024-09-22T03:06:18.797891+0000","last_clean":"2024-09-22T03:06:18.797891+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:06:18.797891+0000","last_undegraded":"2024-09-22T03:06:18.797891+0000","last_fullsized":"2024-09-22T03:06:18.797891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'1639","reported_seq":1652,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.032583+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:07:45.032583+0000","last_peered":"2024-09-22T03:07:45.032583+0000","last_clean":"2024-09-22T03:07:45.032583+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:07:45.032583+0000","last_undegraded":"2024-09-22T03:07:45.032583+0000","last_fullsized":"2024-09-22T03:07:45.032583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1639,"log_dups_size":0,"ondisk_log_size":1639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1640,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.801352+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:06:18.801352+0000","last_peered":"2024-09-22T03:06:18.801352+0000","last_clean":"2024-09-22T03:06:18.801352+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:06:18.801352+0000","last_undegraded":"2024-09-22T03:06:18.801352+0000","last_fullsized":"2024-09-22T03:06:18.801352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803187+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:06:18.803187+0000","last_peered":"2024-09-22T03:06:18.803187+0000","last_clean":"2024-09-22T03:06:18.803187+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:06:18.803187+0000","last_undegraded":"2024-09-22T03:06:18.803187+0000","last_fullsized":"2024-09-22T03:06:18.803187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'1639","reported_seq":1652,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.616865+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:07:46.616865+0000","last_peered":"2024-09-22T03:07:46.616865+0000","last_clean":"2024-09-22T03:07:46.616865+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:07:46.616865+0000","last_undegraded":"2024-09-22T03:07:46.616865+0000","last_fullsized":"2024-09-22T03:07:46.616865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1639,"log_dups_size":0,"ondisk_log_size":1639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1640,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.797975+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:06:18.797975+0000","last_peered":"2024-09-22T03:06:18.797975+0000","last_clean":"2024-09-22T03:06:18.797975+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:06:18.797975+0000","last_undegraded":"2024-09-22T03:06:18.797975+0000","last_fullsized":"2024-09-22T03:06:18.797975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'1503","reported_seq":1516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.677775+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:07:45.677775+0000","last_peered":"2024-09-22T03:07:45.677775+0000","last_clean":"2024-09-22T03:07:45.677775+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:07:45.677775+0000","last_undegraded":"2024-09-22T03:07:45.677775+0000","last_fullsized":"2024-09-22T03:07:45.677775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12320768,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1504,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.802226+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:06:18.802226+0000","last_peered":"2024-09-22T03:06:18.802226+0000","last_clean":"2024-09-22T03:06:18.802226+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:06:18.802226+0000","last_undegraded":"2024-09-22T03:06:18.802226+0000","last_fullsized":"2024-09-22T03:06:18.802226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"29'1615","reported_seq":1628,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.269126+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:07:45.269126+0000","last_peered":"2024-09-22T03:07:45.269126+0000","last_clean":"2024-09-22T03:07:45.269126+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:07:45.269126+0000","last_undegraded":"2024-09-22T03:07:45.269126+0000","last_fullsized":"2024-09-22T03:07:45.269126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1616,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.803519+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:06:18.803519+0000","last_peered":"2024-09-22T03:06:18.803519+0000","last_clean":"2024-09-22T03:06:18.803519+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:06:18.803519+0000","last_undegraded":"2024-09-22T03:06:18.803519+0000","last_fullsized":"2024-09-22T03:06:18.803519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'1719","reported_seq":1732,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.200725+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:07:46.200725+0000","last_peered":"2024-09-22T03:07:46.200725+0000","last_clean":"2024-09-22T03:07:46.200725+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:07:46.200725+0000","last_undegraded":"2024-09-22T03:07:46.200725+0000","last_fullsized":"2024-09-22T03:07:46.200725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1720,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:06:18.805367+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:06:18.805367+0000","last_peered":"2024-09-22T03:06:18.805367+0000","last_clean":"2024-09-22T03:06:18.805367+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:06:18.805367+0000","last_undegraded":"2024-09-22T03:06:18.805367+0000","last_fullsized":"2024-09-22T03:06:18.805367+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":211419136,"num_objects":3228,"num_object_clones":0,"num_object_copies":9684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25808,"num_write_kb":206464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":317218816,"data_stored":634437632,"data_compressed":32756322,"data_compressed_allocated":317218816,"data_compressed_original":634437632,"omap_allocated":0,"internal_metadata":0},"log_size":25792,"ondisk_log_size":25792,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":172232,"kb_used_data":82936,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94199608,"statfs":{"total":96636764160,"available":96460398592,"internally_reserved":0,"allocated":84926464,"data_stored":169435110,"data_compressed":8743728,"data_compressed_allocated":84676608,"data_compressed_original":169353216,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128256,"kb_used_data":65328,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94243584,"statfs":{"total":96636764160,"available":96505430016,"internally_reserved":0,"allocated":66895872,"data_stored":133841414,"data_compressed":6905580,"data_compressed_allocated":66625536,"data_compressed_original":133742592,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":155160,"kb_used_data":83912,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94216680,"statfs":{"total":96636764160,"available":96477880320,"internally_reserved":0,"allocated":85925888,"data_stored":171901446,"data_compressed":8870602,"data_compressed_allocated":85655552,"data_compressed_original":171802624,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":147688,"kb_used_data":76440,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94224152,"statfs":{"total":96636764160,"available":96485531648,"internally_reserved":0,"allocated":78274560,"data_stored":156606963,"data_compressed":8080952,"data_compressed_allocated":78008320,"data_compressed_original":156508160,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":78475264,"data_stored":156950528,"data_compressed":8103444,"data_compressed_allocated":78475264,"data_compressed_original":156950528,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86294528,"data_stored":172589056,"data_compressed":8910860,"data_compressed_allocated":86294528,"data_compressed_original":172589056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":67014656,"data_stored":134029312,"data_compressed":6920035,"data_compressed_allocated":67014656,"data_compressed_original":134029312,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":85434368,"data_stored":170868736,"data_compressed":8821983,"data_compressed_allocated":85434368,"data_compressed_original":170868736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:51.528 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:07:51.528 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:51.528 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:07:51.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:07:51.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:51.658+0000 7fd369aba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:51.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:51.673+0000 7fd369aba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:51.707 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:51.707 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:51.707 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:51.707 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:51.707 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:51.707 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:51.707 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:51.707 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:51.707 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:51.708 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:51.708 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:51.708 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:51.711 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:51.711 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:51.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:07:51.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:51.857+0000 7fab66f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:51.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:51.869+0000 7fab66f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:52.045 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:52.045 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:52.045 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:52.045 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:52.045 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:52.045 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:52.045 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:52.045 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:52.045 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:52.045 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:52.045 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:52.046 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:52.049 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:52.049 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:52.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:07:52.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:52.190+0000 7f6537397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:52.201+0000 7f6537397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:52.220 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:52.220 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:52.220 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:52.220 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:52.220 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:52.220 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:52.221 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:52.221 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:52.221 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:52.221 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:52.221 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:52.221 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:52.224 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:52.224 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:52.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:07:52.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:52.383+0000 7f2b94f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:52.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:52.397+0000 7f2b94f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:07:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:07:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:07:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:07:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:07:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:07:52.421 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:07:52.421 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:07:52.421 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:07:52.421 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:07:52.421 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:07:52.425 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:52.425 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:52.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:52.432+0000 7f0441663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:52.439+0000 7f0441663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:54.806 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:54.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:54.956+0000 7fe932d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:54.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:54.964+0000 7fe932d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:57.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:57.426 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:57.426 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:57.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:57.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:57.490+0000 7ffaff317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:57.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:57.499+0000 7ffaff317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:57.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:57.580+0000 7fe17e0ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:57.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:57.591+0000 7fe17e0ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:07:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:07:57.901 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-09-22T03:07:56.728834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":159359563,"num_objects":2428,"num_object_clones":0,"num_object_copies":7284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":27360,"num_write_kb":212689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27305,"ondisk_log_size":27305,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":576008,"kb_used_data":259016,"kb_used_omap":0,"kb_used_meta":316864,"kb_avail":376911352,"statfs":{"total":386547056640,"available":385957224448,"internally_reserved":0,"allocated":265232384,"data_stored":529969853,"data_compressed":27344187,"data_compressed_allocated":264032256,"data_compressed_original":529539072,"omap_allocated":0,"internal_metadata":324468736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52649960,"num_objects":-804,"num_object_clones":0,"num_object_copies":-2412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1413,"num_write_kb":4329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001237"},"pg_stats":[{"pgid":"4.f","version":"33'1502","reported_seq":1527,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.596928+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:07:51.596928+0000","last_peered":"2024-09-22T03:07:51.596928+0000","last_clean":"2024-09-22T03:07:51.596928+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:07:51.596928+0000","last_undegraded":"2024-09-22T03:07:51.596928+0000","last_fullsized":"2024-09-22T03:07:51.596928+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1502,"log_dups_size":0,"ondisk_log_size":1502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1503,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"33'1618","reported_seq":1643,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.595897+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:07:51.595897+0000","last_peered":"2024-09-22T03:07:51.595897+0000","last_clean":"2024-09-22T03:07:51.595897+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:07:51.595897+0000","last_undegraded":"2024-09-22T03:07:51.595897+0000","last_fullsized":"2024-09-22T03:07:51.595897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1618,"log_dups_size":0,"ondisk_log_size":1618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1619,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"33'1600","reported_seq":1626,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.635399+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:07:51.635399+0000","last_peered":"2024-09-22T03:07:51.635399+0000","last_clean":"2024-09-22T03:07:51.635399+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:07:51.635399+0000","last_undegraded":"2024-09-22T03:07:51.635399+0000","last_fullsized":"2024-09-22T03:07:51.635399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1600,"log_dups_size":0,"ondisk_log_size":1600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747928,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1601,"num_write_kb":12545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'1856","reported_seq":1881,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.723117+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:07:51.723117+0000","last_peered":"2024-09-22T03:07:51.723117+0000","last_clean":"2024-09-22T03:07:51.723117+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:07:51.723117+0000","last_undegraded":"2024-09-22T03:07:51.723117+0000","last_fullsized":"2024-09-22T03:07:51.723117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1856,"log_dups_size":0,"ondisk_log_size":1856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1857,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"33'1999","reported_seq":2024,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:55.621181+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:07:55.621181+0000","last_peered":"2024-09-22T03:07:55.621181+0000","last_clean":"2024-09-22T03:07:55.621181+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:07:55.621181+0000","last_undegraded":"2024-09-22T03:07:55.621181+0000","last_fullsized":"2024-09-22T03:07:55.621181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1999,"log_dups_size":0,"ondisk_log_size":1999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2000,"num_write_kb":14976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"33'1656","reported_seq":1681,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.631788+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:07:51.631788+0000","last_peered":"2024-09-22T03:07:51.631788+0000","last_clean":"2024-09-22T03:07:51.631788+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:07:51.631788+0000","last_undegraded":"2024-09-22T03:07:51.631788+0000","last_fullsized":"2024-09-22T03:07:51.631788+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1656,"log_dups_size":0,"ondisk_log_size":1656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1657,"num_write_kb":12992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"33'1599","reported_seq":1624,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.644799+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:07:51.644799+0000","last_peered":"2024-09-22T03:07:51.644799+0000","last_clean":"2024-09-22T03:07:51.644799+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:07:51.644799+0000","last_undegraded":"2024-09-22T03:07:51.644799+0000","last_fullsized":"2024-09-22T03:07:51.644799+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1599,"log_dups_size":0,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1600,"num_write_kb":12544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"33'1646","reported_seq":1671,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.505011+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:07:51.505011+0000","last_peered":"2024-09-22T03:07:51.505011+0000","last_clean":"2024-09-22T03:07:51.505011+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:07:51.505011+0000","last_undegraded":"2024-09-22T03:07:51.505011+0000","last_fullsized":"2024-09-22T03:07:51.505011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1646,"log_dups_size":0,"ondisk_log_size":1646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1647,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'1544","reported_seq":1569,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.688046+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:07:51.688046+0000","last_peered":"2024-09-22T03:07:51.688046+0000","last_clean":"2024-09-22T03:07:51.688046+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:07:51.688046+0000","last_undegraded":"2024-09-22T03:07:51.688046+0000","last_fullsized":"2024-09-22T03:07:51.688046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1544,"log_dups_size":0,"ondisk_log_size":1544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1545,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.468250+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:07:50.468250+0000","last_peered":"2024-09-22T03:07:50.468250+0000","last_clean":"2024-09-22T03:07:50.468250+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:07:50.468250+0000","last_undegraded":"2024-09-22T03:07:50.468250+0000","last_fullsized":"2024-09-22T03:07:50.468250+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'1758","reported_seq":1783,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.700410+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:07:51.700410+0000","last_peered":"2024-09-22T03:07:51.700410+0000","last_clean":"2024-09-22T03:07:51.700410+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:07:51.700410+0000","last_undegraded":"2024-09-22T03:07:51.700410+0000","last_fullsized":"2024-09-22T03:07:51.700410+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1758,"log_dups_size":0,"ondisk_log_size":1758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1759,"num_write_kb":13824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.491822+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:07:50.491822+0000","last_peered":"2024-09-22T03:07:50.491822+0000","last_clean":"2024-09-22T03:07:50.491822+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:07:50.491822+0000","last_undegraded":"2024-09-22T03:07:50.491822+0000","last_fullsized":"2024-09-22T03:07:50.491822+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"33'1725","reported_seq":1750,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.674029+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:07:51.674029+0000","last_peered":"2024-09-22T03:07:51.674029+0000","last_clean":"2024-09-22T03:07:51.674029+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:07:51.674029+0000","last_undegraded":"2024-09-22T03:07:51.674029+0000","last_fullsized":"2024-09-22T03:07:51.674029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11337728,"num_objects":173,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1726,"num_write_kb":13504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.468861+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:07:50.468861+0000","last_peered":"2024-09-22T03:07:50.468861+0000","last_clean":"2024-09-22T03:07:50.468861+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:07:50.468861+0000","last_undegraded":"2024-09-22T03:07:50.468861+0000","last_fullsized":"2024-09-22T03:07:50.468861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'1823","reported_seq":1848,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:55.615384+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:07:55.615384+0000","last_peered":"2024-09-22T03:07:55.615384+0000","last_clean":"2024-09-22T03:07:55.615384+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:07:55.615384+0000","last_undegraded":"2024-09-22T03:07:55.615384+0000","last_fullsized":"2024-09-22T03:07:55.615384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1823,"log_dups_size":0,"ondisk_log_size":1823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1824,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.475308+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:07:50.475308+0000","last_peered":"2024-09-22T03:07:50.475308+0000","last_clean":"2024-09-22T03:07:50.475308+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:07:50.475308+0000","last_undegraded":"2024-09-22T03:07:50.475308+0000","last_fullsized":"2024-09-22T03:07:50.475308+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":199,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.494812+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:07:50.494812+0000","last_peered":"2024-09-22T03:07:50.494812+0000","last_clean":"2024-09-22T03:07:50.494812+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:07:50.494812+0000","last_undegraded":"2024-09-22T03:07:50.494812+0000","last_fullsized":"2024-09-22T03:07:50.494812+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"33'1691","reported_seq":1716,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.585355+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:07:51.585355+0000","last_peered":"2024-09-22T03:07:51.585355+0000","last_clean":"2024-09-22T03:07:51.585355+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:07:51.585355+0000","last_undegraded":"2024-09-22T03:07:51.585355+0000","last_fullsized":"2024-09-22T03:07:51.585355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1692,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.469127+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:07:50.469127+0000","last_peered":"2024-09-22T03:07:50.469127+0000","last_clean":"2024-09-22T03:07:50.469127+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:07:50.469127+0000","last_undegraded":"2024-09-22T03:07:50.469127+0000","last_fullsized":"2024-09-22T03:07:50.469127+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'1661","reported_seq":1686,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:55.626819+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:07:55.626819+0000","last_peered":"2024-09-22T03:07:55.626819+0000","last_clean":"2024-09-22T03:07:55.626819+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:07:55.626819+0000","last_undegraded":"2024-09-22T03:07:55.626819+0000","last_fullsized":"2024-09-22T03:07:55.626819+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1661,"log_dups_size":0,"ondisk_log_size":1661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1662,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.472623+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:07:50.472623+0000","last_peered":"2024-09-22T03:07:50.472623+0000","last_clean":"2024-09-22T03:07:50.472623+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:07:50.472623+0000","last_undegraded":"2024-09-22T03:07:50.472623+0000","last_fullsized":"2024-09-22T03:07:50.472623+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"33'1760","reported_seq":1785,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:55.598318+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:07:55.598318+0000","last_peered":"2024-09-22T03:07:55.598318+0000","last_clean":"2024-09-22T03:07:55.598318+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:07:55.598318+0000","last_undegraded":"2024-09-22T03:07:55.598318+0000","last_fullsized":"2024-09-22T03:07:55.598318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6463488,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1761,"num_write_kb":13224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.473122+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:07:50.473122+0000","last_peered":"2024-09-22T03:07:50.473122+0000","last_clean":"2024-09-22T03:07:50.473122+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:07:50.473122+0000","last_undegraded":"2024-09-22T03:07:50.473122+0000","last_fullsized":"2024-09-22T03:07:50.473122+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'1767","reported_seq":1792,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:51.628010+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:07:51.628010+0000","last_peered":"2024-09-22T03:07:51.628010+0000","last_clean":"2024-09-22T03:07:51.628010+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:07:51.628010+0000","last_undegraded":"2024-09-22T03:07:51.628010+0000","last_fullsized":"2024-09-22T03:07:51.628010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1768,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.475556+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:07:50.475556+0000","last_peered":"2024-09-22T03:07:50.475556+0000","last_clean":"2024-09-22T03:07:50.475556+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:07:50.475556+0000","last_undegraded":"2024-09-22T03:07:50.475556+0000","last_fullsized":"2024-09-22T03:07:50.475556+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":158769176,"num_objects":2424,"num_object_clones":0,"num_object_copies":7272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":27221,"num_write_kb":210793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":240623616,"data_stored":481222728,"data_compressed":24848283,"data_compressed_allocated":240611328,"data_compressed_original":481222656,"omap_allocated":0,"internal_metadata":0},"log_size":27205,"ondisk_log_size":27205,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":170692,"kb_used_data":77236,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94201148,"statfs":{"total":96636764160,"available":96461975552,"internally_reserved":0,"allocated":79089664,"data_stored":157709066,"data_compressed":8138519,"data_compressed_allocated":78807040,"data_compressed_original":157614080,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128152,"kb_used_data":61064,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94243688,"statfs":{"total":96636764160,"available":96505536512,"internally_reserved":0,"allocated":62529536,"data_stored":125048130,"data_compressed":6451521,"data_compressed_allocated":62222336,"data_compressed_original":124936192,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":171704,"kb_used_data":78184,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94200136,"statfs":{"total":96636764160,"available":96460939264,"internally_reserved":0,"allocated":80060416,"data_stored":160109890,"data_compressed":8261961,"data_compressed_allocated":79753216,"data_compressed_original":159997952,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105460,"kb_used_data":42532,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94266380,"statfs":{"total":96636764160,"available":96528773120,"internally_reserved":0,"allocated":43552768,"data_stored":87102767,"data_compressed":4492186,"data_compressed_allocated":43249664,"data_compressed_original":86990848,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37412864,"data_stored":74817560,"data_compressed":3863258,"data_compressed_allocated":37408768,"data_compressed_original":74817536,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73687040,"data_stored":147365912,"data_compressed":7609345,"data_compressed_allocated":73682944,"data_compressed_original":147365888,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57139200,"data_stored":114270232,"data_compressed":5900425,"data_compressed_allocated":57135104,"data_compressed_original":114270208,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":72384512,"data_stored":144769024,"data_compressed":7475255,"data_compressed_allocated":72384512,"data_compressed_original":144769024,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:59.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:59.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:59.927+0000 7fc012aba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:59.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:07:59.935+0000 7fc012aba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:00.947 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Removed 3294 objects 2024-09-22T03:08:00.947 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Clean up completed and total clean up time :11.0668 2024-09-22T03:08:02.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:02.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:02.271+0000 7f0e4d797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:02.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:02.276+0000 7f0e4d797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:02.544 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2024-09-22T03:08:02.545 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-09-22T03:08:02.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:02.643+0000 7f3f6602c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:02.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:02.654+0000 7f3f6602c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:02.903 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:02.903 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:02.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:08:03.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:03.003+0000 7f77d8757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:03.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:03.009+0000 7f77d8757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:03.186 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:08:03.186 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:08:03.198 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-09-22T03:08:02.729947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1548851,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":29769,"num_write_kb":212689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29714,"ondisk_log_size":29714,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":317296,"kb_used_data":8624,"kb_used_omap":0,"kb_used_meta":308544,"kb_avail":377170064,"statfs":{"total":386547056640,"available":386222145536,"internally_reserved":0,"allocated":8830976,"data_stored":17175205,"data_compressed":865662,"data_compressed_allocated":7634944,"data_compressed_original":16744448,"omap_allocated":0,"internal_metadata":315949056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-210460672,"num_objects":-3213,"num_object_clones":0,"num_object_copies":-9639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3822,"num_write_kb":4329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002115"},"pg_stats":[{"pgid":"4.f","version":"33'1655","reported_seq":1680,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.589624+0000","last_change":"2024-09-22T03:06:17.851104+0000","last_active":"2024-09-22T03:08:00.589624+0000","last_peered":"2024-09-22T03:08:00.589624+0000","last_clean":"2024-09-22T03:08:00.589624+0000","last_became_active":"2024-09-22T03:06:17.847835+0000","last_became_peered":"2024-09-22T03:06:17.847835+0000","last_unstale":"2024-09-22T03:08:00.589624+0000","last_undegraded":"2024-09-22T03:08:00.589624+0000","last_fullsized":"2024-09-22T03:08:00.589624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1655,"log_dups_size":0,"ondisk_log_size":1655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1656,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"33'1781","reported_seq":1806,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.886380+0000","last_change":"2024-09-22T03:06:17.860303+0000","last_active":"2024-09-22T03:08:00.886380+0000","last_peered":"2024-09-22T03:08:00.886380+0000","last_clean":"2024-09-22T03:08:00.886380+0000","last_became_active":"2024-09-22T03:06:17.853573+0000","last_became_peered":"2024-09-22T03:06:17.853573+0000","last_unstale":"2024-09-22T03:08:00.886380+0000","last_undegraded":"2024-09-22T03:08:00.886380+0000","last_fullsized":"2024-09-22T03:08:00.886380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1781,"log_dups_size":0,"ondisk_log_size":1781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1782,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"33'1765","reported_seq":1791,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.879166+0000","last_change":"2024-09-22T03:06:17.856853+0000","last_active":"2024-09-22T03:08:00.879166+0000","last_peered":"2024-09-22T03:08:00.879166+0000","last_clean":"2024-09-22T03:08:00.879166+0000","last_became_active":"2024-09-22T03:06:17.851940+0000","last_became_peered":"2024-09-22T03:06:17.851940+0000","last_unstale":"2024-09-22T03:08:00.879166+0000","last_undegraded":"2024-09-22T03:08:00.879166+0000","last_fullsized":"2024-09-22T03:08:00.879166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1765,"log_dups_size":0,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1766,"num_write_kb":12545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'2033","reported_seq":2058,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.903390+0000","last_change":"2024-09-22T03:06:17.848187+0000","last_active":"2024-09-22T03:08:00.903390+0000","last_peered":"2024-09-22T03:08:00.903390+0000","last_clean":"2024-09-22T03:08:00.903390+0000","last_became_active":"2024-09-22T03:06:17.835449+0000","last_became_peered":"2024-09-22T03:06:17.835449+0000","last_unstale":"2024-09-22T03:08:00.903390+0000","last_undegraded":"2024-09-22T03:08:00.903390+0000","last_fullsized":"2024-09-22T03:08:00.903390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2034,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"33'2102","reported_seq":2127,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.636000+0000","last_change":"2024-09-22T03:06:17.895321+0000","last_active":"2024-09-22T03:08:00.636000+0000","last_peered":"2024-09-22T03:08:00.636000+0000","last_clean":"2024-09-22T03:08:00.636000+0000","last_became_active":"2024-09-22T03:06:17.891437+0000","last_became_peered":"2024-09-22T03:06:17.891437+0000","last_unstale":"2024-09-22T03:08:00.636000+0000","last_undegraded":"2024-09-22T03:08:00.636000+0000","last_fullsized":"2024-09-22T03:08:00.636000+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":2102,"log_dups_size":0,"ondisk_log_size":2102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2103,"num_write_kb":14976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"33'1826","reported_seq":1851,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.868623+0000","last_change":"2024-09-22T03:06:17.861234+0000","last_active":"2024-09-22T03:08:00.868623+0000","last_peered":"2024-09-22T03:08:00.868623+0000","last_clean":"2024-09-22T03:08:00.868623+0000","last_became_active":"2024-09-22T03:06:17.855980+0000","last_became_peered":"2024-09-22T03:06:17.855980+0000","last_unstale":"2024-09-22T03:08:00.868623+0000","last_undegraded":"2024-09-22T03:08:00.868623+0000","last_fullsized":"2024-09-22T03:08:00.868623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1826,"log_dups_size":0,"ondisk_log_size":1826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1827,"num_write_kb":12992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"33'1763","reported_seq":1788,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.845713+0000","last_change":"2024-09-22T03:06:17.848257+0000","last_active":"2024-09-22T03:08:00.845713+0000","last_peered":"2024-09-22T03:08:00.845713+0000","last_clean":"2024-09-22T03:08:00.845713+0000","last_became_active":"2024-09-22T03:06:17.842822+0000","last_became_peered":"2024-09-22T03:06:17.842822+0000","last_unstale":"2024-09-22T03:08:00.845713+0000","last_undegraded":"2024-09-22T03:08:00.845713+0000","last_fullsized":"2024-09-22T03:08:00.845713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1763,"log_dups_size":0,"ondisk_log_size":1763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1764,"num_write_kb":12544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"33'1817","reported_seq":1842,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.807223+0000","last_change":"2024-09-22T03:06:17.845852+0000","last_active":"2024-09-22T03:08:00.807223+0000","last_peered":"2024-09-22T03:08:00.807223+0000","last_clean":"2024-09-22T03:08:00.807223+0000","last_became_active":"2024-09-22T03:06:17.839993+0000","last_became_peered":"2024-09-22T03:06:17.839993+0000","last_unstale":"2024-09-22T03:08:00.807223+0000","last_undegraded":"2024-09-22T03:08:00.807223+0000","last_fullsized":"2024-09-22T03:08:00.807223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1817,"log_dups_size":0,"ondisk_log_size":1817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'1700","reported_seq":1725,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.862812+0000","last_change":"2024-09-22T03:06:17.865572+0000","last_active":"2024-09-22T03:08:00.862812+0000","last_peered":"2024-09-22T03:08:00.862812+0000","last_clean":"2024-09-22T03:08:00.862812+0000","last_became_active":"2024-09-22T03:06:17.860421+0000","last_became_peered":"2024-09-22T03:06:17.860421+0000","last_unstale":"2024-09-22T03:08:00.862812+0000","last_undegraded":"2024-09-22T03:08:00.862812+0000","last_fullsized":"2024-09-22T03:08:00.862812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.468250+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:07:50.468250+0000","last_peered":"2024-09-22T03:07:50.468250+0000","last_clean":"2024-09-22T03:07:50.468250+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:07:50.468250+0000","last_undegraded":"2024-09-22T03:07:50.468250+0000","last_fullsized":"2024-09-22T03:07:50.468250+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'1943","reported_seq":1968,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.891927+0000","last_change":"2024-09-22T03:06:17.870636+0000","last_active":"2024-09-22T03:08:00.891927+0000","last_peered":"2024-09-22T03:08:00.891927+0000","last_clean":"2024-09-22T03:08:00.891927+0000","last_became_active":"2024-09-22T03:06:17.864839+0000","last_became_peered":"2024-09-22T03:06:17.864839+0000","last_unstale":"2024-09-22T03:08:00.891927+0000","last_undegraded":"2024-09-22T03:08:00.891927+0000","last_fullsized":"2024-09-22T03:08:00.891927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1944,"num_write_kb":13824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.491822+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:07:50.491822+0000","last_peered":"2024-09-22T03:07:50.491822+0000","last_clean":"2024-09-22T03:07:50.491822+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:07:50.491822+0000","last_undegraded":"2024-09-22T03:07:50.491822+0000","last_fullsized":"2024-09-22T03:07:50.491822+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"33'1898","reported_seq":1923,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.732096+0000","last_change":"2024-09-22T03:06:17.842986+0000","last_active":"2024-09-22T03:08:00.732096+0000","last_peered":"2024-09-22T03:08:00.732096+0000","last_clean":"2024-09-22T03:08:00.732096+0000","last_became_active":"2024-09-22T03:06:17.837332+0000","last_became_peered":"2024-09-22T03:06:17.837332+0000","last_unstale":"2024-09-22T03:08:00.732096+0000","last_undegraded":"2024-09-22T03:08:00.732096+0000","last_fullsized":"2024-09-22T03:08:00.732096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1898,"log_dups_size":0,"ondisk_log_size":1898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1899,"num_write_kb":13504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.468861+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:07:50.468861+0000","last_peered":"2024-09-22T03:07:50.468861+0000","last_clean":"2024-09-22T03:07:50.468861+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:07:50.468861+0000","last_undegraded":"2024-09-22T03:07:50.468861+0000","last_fullsized":"2024-09-22T03:07:50.468861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'1911","reported_seq":1936,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.682787+0000","last_change":"2024-09-22T03:06:17.856206+0000","last_active":"2024-09-22T03:08:00.682787+0000","last_peered":"2024-09-22T03:08:00.682787+0000","last_clean":"2024-09-22T03:08:00.682787+0000","last_became_active":"2024-09-22T03:06:17.849433+0000","last_became_peered":"2024-09-22T03:06:17.849433+0000","last_unstale":"2024-09-22T03:08:00.682787+0000","last_undegraded":"2024-09-22T03:08:00.682787+0000","last_fullsized":"2024-09-22T03:08:00.682787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1911,"log_dups_size":0,"ondisk_log_size":1911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1912,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.475308+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:07:50.475308+0000","last_peered":"2024-09-22T03:07:50.475308+0000","last_clean":"2024-09-22T03:07:50.475308+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:07:50.475308+0000","last_undegraded":"2024-09-22T03:07:50.475308+0000","last_fullsized":"2024-09-22T03:07:50.475308+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":199,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.494812+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:07:50.494812+0000","last_peered":"2024-09-22T03:07:50.494812+0000","last_clean":"2024-09-22T03:07:50.494812+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:07:50.494812+0000","last_undegraded":"2024-09-22T03:07:50.494812+0000","last_fullsized":"2024-09-22T03:07:50.494812+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"33'1871","reported_seq":1896,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.846536+0000","last_change":"2024-09-22T03:06:17.885515+0000","last_active":"2024-09-22T03:08:00.846536+0000","last_peered":"2024-09-22T03:08:00.846536+0000","last_clean":"2024-09-22T03:08:00.846536+0000","last_became_active":"2024-09-22T03:06:17.880633+0000","last_became_peered":"2024-09-22T03:06:17.880633+0000","last_unstale":"2024-09-22T03:08:00.846536+0000","last_undegraded":"2024-09-22T03:08:00.846536+0000","last_fullsized":"2024-09-22T03:08:00.846536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1871,"log_dups_size":0,"ondisk_log_size":1871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1872,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.469127+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:07:50.469127+0000","last_peered":"2024-09-22T03:07:50.469127+0000","last_clean":"2024-09-22T03:07:50.469127+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:07:50.469127+0000","last_undegraded":"2024-09-22T03:07:50.469127+0000","last_fullsized":"2024-09-22T03:07:50.469127+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'1742","reported_seq":1767,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.670350+0000","last_change":"2024-09-22T03:06:17.873837+0000","last_active":"2024-09-22T03:08:00.670350+0000","last_peered":"2024-09-22T03:08:00.670350+0000","last_clean":"2024-09-22T03:08:00.670350+0000","last_became_active":"2024-09-22T03:06:17.870528+0000","last_became_peered":"2024-09-22T03:06:17.870528+0000","last_unstale":"2024-09-22T03:08:00.670350+0000","last_undegraded":"2024-09-22T03:08:00.670350+0000","last_fullsized":"2024-09-22T03:08:00.670350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1742,"log_dups_size":0,"ondisk_log_size":1742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1743,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.472623+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:07:50.472623+0000","last_peered":"2024-09-22T03:07:50.472623+0000","last_clean":"2024-09-22T03:07:50.472623+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:07:50.472623+0000","last_undegraded":"2024-09-22T03:07:50.472623+0000","last_fullsized":"2024-09-22T03:07:50.472623+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"33'1855","reported_seq":1880,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.576729+0000","last_change":"2024-09-22T03:06:17.893644+0000","last_active":"2024-09-22T03:08:00.576729+0000","last_peered":"2024-09-22T03:08:00.576729+0000","last_clean":"2024-09-22T03:08:00.576729+0000","last_became_active":"2024-09-22T03:06:17.888759+0000","last_became_peered":"2024-09-22T03:06:17.888759+0000","last_unstale":"2024-09-22T03:08:00.576729+0000","last_undegraded":"2024-09-22T03:08:00.576729+0000","last_fullsized":"2024-09-22T03:08:00.576729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":237568,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1856,"num_write_kb":13224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.473122+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:07:50.473122+0000","last_peered":"2024-09-22T03:07:50.473122+0000","last_clean":"2024-09-22T03:07:50.473122+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:07:50.473122+0000","last_undegraded":"2024-09-22T03:07:50.473122+0000","last_fullsized":"2024-09-22T03:07:50.473122+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'1952","reported_seq":1977,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:08:00.761423+0000","last_change":"2024-09-22T03:06:17.875938+0000","last_active":"2024-09-22T03:08:00.761423+0000","last_peered":"2024-09-22T03:08:00.761423+0000","last_clean":"2024-09-22T03:08:00.761423+0000","last_became_active":"2024-09-22T03:06:17.871408+0000","last_became_peered":"2024-09-22T03:06:17.871408+0000","last_unstale":"2024-09-22T03:08:00.761423+0000","last_undegraded":"2024-09-22T03:08:00.761423+0000","last_fullsized":"2024-09-22T03:08:00.761423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:06:16.771291+0000","last_clean_scrub_stamp":"2024-09-22T03:06:16.771291+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1953,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-22T03:07:50.475556+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:07:50.475556+0000","last_peered":"2024-09-22T03:07:50.475556+0000","last_clean":"2024-09-22T03:07:50.475556+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:07:50.475556+0000","last_undegraded":"2024-09-22T03:07:50.475556+0000","last_fullsized":"2024-09-22T03:07:50.475556+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":958464,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":29630,"num_write_kb":210793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1531904,"data_stored":3055640,"data_compressed":157779,"data_compressed_allocated":1527808,"data_compressed_original":3055616,"omap_allocated":0,"internal_metadata":0},"log_size":29614,"ondisk_log_size":29614,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85508,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94286332,"statfs":{"total":96636764160,"available":96549203968,"internally_reserved":0,"allocated":380928,"data_stored":291594,"data_compressed":10152,"data_compressed_allocated":98304,"data_compressed_original":196608,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72024,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94299816,"statfs":{"total":96636764160,"available":96563011584,"internally_reserved":0,"allocated":794624,"data_stored":1578306,"data_compressed":76067,"data_compressed_allocated":487424,"data_compressed_original":1466368,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85472,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94286368,"statfs":{"total":96636764160,"available":96549240832,"internally_reserved":0,"allocated":344064,"data_stored":685354,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74292,"kb_used_data":7140,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94297548,"statfs":{"total":96636764160,"available":96560689152,"internally_reserved":0,"allocated":7311360,"data_stored":14619951,"data_compressed":749483,"data_compressed_allocated":7008256,"data_compressed_original":14508032,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1531904,"data_stored":3055640,"data_compressed":157779,"data_compressed_allocated":1527808,"data_compressed_original":3055616,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:08:03.399 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_1' removed 2024-09-22T03:08:03.415 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:08:03.415 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:08:03.415 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2024-09-22T03:08:03.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 16 2024-09-22T03:08:03.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:03.539+0000 7f891746c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:03.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:03.557+0000 7f891746c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:04.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:04.399 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_2' created 2024-09-22T03:08:04.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-09-22T03:08:04.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:04.466+0000 7f0e95797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:04.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:04.472+0000 7f0e95797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:04.534+0000 7f4bf906c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:04.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:04.551+0000 7f4bf906c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:05.414 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-09-22T03:08:06.437 DEBUG:teuthology.orchestra.run.smithi134:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-09-22T03:08:06.440 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:08:06.440 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:08:06.502 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:hints = 1 2024-09-22T03:08:06.502 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:08:06.502 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object prefix: benchmark_data_smithi134_38536 2024-09-22T03:08:06.502 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:08:06.502 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:08:06.552 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:06.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:06.689+0000 7f15c7c18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:06.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:06.695+0000 7f15c7c18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:07.502 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 1 16 357 341 2.66392 2.66406 0.0344027 0.0460558 2024-09-22T03:08:08.200 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:08.201 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:08.201 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:08.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:08.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:08.327+0000 7fec16157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:08.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:08.340+0000 7fec16157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:08.390 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:08.390 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:08.390 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:08.390 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:08.390 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:08.390 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:08.390 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:08.390 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:08.391 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:08.391 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:08.391 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:08.391 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:08.393 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:08.394 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:08.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:08.502 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 2 16 721 705 2.75373 2.84375 0.0659495 0.0448756 2024-09-22T03:08:08.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:08.528+0000 7fae07d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:08.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:08.540+0000 7fae07d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:08.557 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:08.557 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:08.557 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:08.558 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:08.558 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:08.558 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:08.558 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:08.558 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:08.558 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:08.558 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:08.558 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:08.558 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:08.562 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:08.562 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:08.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:08.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:08.709+0000 7fbc95197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:08.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:08.718+0000 7fbc95197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:08.739 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:08.739 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:08.739 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:08.739 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:08.740 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:08.740 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:08.740 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:08.740 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:08.740 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:08.740 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:08.740 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:08.740 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:08.742 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:08.743 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:08.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:08.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:08.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:08.882+0000 7f1612d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:08.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:08.892+0000 7f1612d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:08.912 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:08.912 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:08.912 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:08.912 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:08.912 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:08.913 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:08.913 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:08.913 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:08.913 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:08.913 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:08.913 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:08.913 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:08.916 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:08.916 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:08.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:08.971+0000 7f7d71757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:08.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:08.977+0000 7f7d71757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:09.502 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 3 16 1029 1013 2.63784 2.40625 0.04821 0.0467794 2024-09-22T03:08:10.502 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 4 16 1385 1369 2.67363 2.78125 0.055082 0.0464102 2024-09-22T03:08:11.081 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:11.217+0000 7f5ac0717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:11.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:11.226+0000 7f5ac0717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:11.502 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 5 16 1747 1731 2.70448 2.82812 0.0336876 0.0459782 2024-09-22T03:08:12.502 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 6 16 2091 2075 2.70162 2.6875 0.0206169 0.0460688 2024-09-22T03:08:13.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:13.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 7 16 2445 2429 2.71073 2.76562 0.0238462 0.0458968 2024-09-22T03:08:13.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:13.502+0000 7fc7b450e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:13.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:13.510+0000 7fc7b450e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:13.916 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:13.917 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:13.917 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:08:14.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:14.028+0000 7fa9de397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:14.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:14.037+0000 7fa9de397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:14.305 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:08:14.305 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:08:14.323 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-09-22T03:08:12.732048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14754355,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":1868,"num_write_kb":15728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1813,"ondisk_log_size":1813,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":331444,"kb_used_data":18668,"kb_used_omap":0,"kb_used_meta":312704,"kb_avail":377155916,"statfs":{"total":386547056640,"available":386207657984,"internally_reserved":0,"allocated":19116032,"data_stored":37523169,"data_compressed":1910103,"data_compressed_allocated":17780736,"data_compressed_original":37036032,"omap_allocated":0,"internal_metadata":320208896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14163968,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1729,"num_write_kb":13832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001618"},"pg_stats":[{"pgid":"5.f","version":"37'79","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:11.471990+0000","last_change":"2024-09-22T03:08:05.527169+0000","last_active":"2024-09-22T03:08:11.471990+0000","last_peered":"2024-09-22T03:08:11.471990+0000","last_clean":"2024-09-22T03:08:11.471990+0000","last_became_active":"2024-09-22T03:08:05.504247+0000","last_became_peered":"2024-09-22T03:08:05.504247+0000","last_unstale":"2024-09-22T03:08:11.471990+0000","last_undegraded":"2024-09-22T03:08:11.471990+0000","last_fullsized":"2024-09-22T03:08:11.471990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"37'95","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:09.921168+0000","last_change":"2024-09-22T03:08:05.505551+0000","last_active":"2024-09-22T03:08:09.921168+0000","last_peered":"2024-09-22T03:08:09.921168+0000","last_clean":"2024-09-22T03:08:09.921168+0000","last_became_active":"2024-09-22T03:08:05.502164+0000","last_became_peered":"2024-09-22T03:08:05.502164+0000","last_unstale":"2024-09-22T03:08:09.921168+0000","last_undegraded":"2024-09-22T03:08:09.921168+0000","last_fullsized":"2024-09-22T03:08:09.921168+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"37'87","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:10.720412+0000","last_change":"2024-09-22T03:08:05.483440+0000","last_active":"2024-09-22T03:08:10.720412+0000","last_peered":"2024-09-22T03:08:10.720412+0000","last_clean":"2024-09-22T03:08:10.720412+0000","last_became_active":"2024-09-22T03:08:05.477343+0000","last_became_peered":"2024-09-22T03:08:05.477343+0000","last_unstale":"2024-09-22T03:08:10.720412+0000","last_undegraded":"2024-09-22T03:08:10.720412+0000","last_fullsized":"2024-09-22T03:08:10.720412+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"37'103","reported_seq":116,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:11.601337+0000","last_change":"2024-09-22T03:08:05.485033+0000","last_active":"2024-09-22T03:08:11.601337+0000","last_peered":"2024-09-22T03:08:11.601337+0000","last_clean":"2024-09-22T03:08:11.601337+0000","last_became_active":"2024-09-22T03:08:05.480835+0000","last_became_peered":"2024-09-22T03:08:05.480835+0000","last_unstale":"2024-09-22T03:08:11.601337+0000","last_undegraded":"2024-09-22T03:08:11.601337+0000","last_fullsized":"2024-09-22T03:08:11.601337+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'127","reported_seq":140,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:10.613880+0000","last_change":"2024-09-22T03:08:05.530920+0000","last_active":"2024-09-22T03:08:10.613880+0000","last_peered":"2024-09-22T03:08:10.613880+0000","last_clean":"2024-09-22T03:08:10.613880+0000","last_became_active":"2024-09-22T03:08:05.527955+0000","last_became_peered":"2024-09-22T03:08:05.527955+0000","last_unstale":"2024-09-22T03:08:10.613880+0000","last_undegraded":"2024-09-22T03:08:10.613880+0000","last_fullsized":"2024-09-22T03:08:10.613880+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"37'79","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:11.367095+0000","last_change":"2024-09-22T03:08:05.534057+0000","last_active":"2024-09-22T03:08:11.367095+0000","last_peered":"2024-09-22T03:08:11.367095+0000","last_clean":"2024-09-22T03:08:11.367095+0000","last_became_active":"2024-09-22T03:08:05.529876+0000","last_became_peered":"2024-09-22T03:08:05.529876+0000","last_unstale":"2024-09-22T03:08:11.367095+0000","last_undegraded":"2024-09-22T03:08:11.367095+0000","last_fullsized":"2024-09-22T03:08:11.367095+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"37'119","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:11.659359+0000","last_change":"2024-09-22T03:08:05.523426+0000","last_active":"2024-09-22T03:08:11.659359+0000","last_peered":"2024-09-22T03:08:11.659359+0000","last_clean":"2024-09-22T03:08:11.659359+0000","last_became_active":"2024-09-22T03:08:05.517777+0000","last_became_peered":"2024-09-22T03:08:05.517777+0000","last_unstale":"2024-09-22T03:08:11.659359+0000","last_undegraded":"2024-09-22T03:08:11.659359+0000","last_fullsized":"2024-09-22T03:08:11.659359+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"37'119","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:10.594879+0000","last_change":"2024-09-22T03:08:05.507606+0000","last_active":"2024-09-22T03:08:10.594879+0000","last_peered":"2024-09-22T03:08:10.594879+0000","last_clean":"2024-09-22T03:08:10.594879+0000","last_became_active":"2024-09-22T03:08:05.500277+0000","last_became_peered":"2024-09-22T03:08:05.500277+0000","last_unstale":"2024-09-22T03:08:10.594879+0000","last_undegraded":"2024-09-22T03:08:10.594879+0000","last_fullsized":"2024-09-22T03:08:10.594879+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"37'119","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:11.040647+0000","last_change":"2024-09-22T03:08:05.498406+0000","last_active":"2024-09-22T03:08:11.040647+0000","last_peered":"2024-09-22T03:08:11.040647+0000","last_clean":"2024-09-22T03:08:11.040647+0000","last_became_active":"2024-09-22T03:08:05.494764+0000","last_became_peered":"2024-09-22T03:08:05.494764+0000","last_unstale":"2024-09-22T03:08:11.040647+0000","last_undegraded":"2024-09-22T03:08:11.040647+0000","last_fullsized":"2024-09-22T03:08:11.040647+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432217+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:08:06.432217+0000","last_peered":"2024-09-22T03:08:06.432217+0000","last_clean":"2024-09-22T03:08:06.432217+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:08:06.432217+0000","last_undegraded":"2024-09-22T03:08:06.432217+0000","last_fullsized":"2024-09-22T03:08:06.432217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"37'159","reported_seq":172,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:11.695426+0000","last_change":"2024-09-22T03:08:05.502489+0000","last_active":"2024-09-22T03:08:11.695426+0000","last_peered":"2024-09-22T03:08:11.695426+0000","last_clean":"2024-09-22T03:08:11.695426+0000","last_became_active":"2024-09-22T03:08:05.493812+0000","last_became_peered":"2024-09-22T03:08:05.493812+0000","last_unstale":"2024-09-22T03:08:11.695426+0000","last_undegraded":"2024-09-22T03:08:11.695426+0000","last_fullsized":"2024-09-22T03:08:11.695426+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432497+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:08:06.432497+0000","last_peered":"2024-09-22T03:08:06.432497+0000","last_clean":"2024-09-22T03:08:06.432497+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:08:06.432497+0000","last_undegraded":"2024-09-22T03:08:06.432497+0000","last_fullsized":"2024-09-22T03:08:06.432497+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'136","reported_seq":149,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:11.511310+0000","last_change":"2024-09-22T03:08:05.492364+0000","last_active":"2024-09-22T03:08:11.511310+0000","last_peered":"2024-09-22T03:08:11.511310+0000","last_clean":"2024-09-22T03:08:11.511310+0000","last_became_active":"2024-09-22T03:08:05.483434+0000","last_became_peered":"2024-09-22T03:08:05.483434+0000","last_unstale":"2024-09-22T03:08:11.511310+0000","last_undegraded":"2024-09-22T03:08:11.511310+0000","last_fullsized":"2024-09-22T03:08:11.511310+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122304,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432168+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:08:06.432168+0000","last_peered":"2024-09-22T03:08:06.432168+0000","last_clean":"2024-09-22T03:08:06.432168+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:08:06.432168+0000","last_undegraded":"2024-09-22T03:08:06.432168+0000","last_fullsized":"2024-09-22T03:08:06.432168+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"37'103","reported_seq":116,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:09.785099+0000","last_change":"2024-09-22T03:08:05.510228+0000","last_active":"2024-09-22T03:08:09.785099+0000","last_peered":"2024-09-22T03:08:09.785099+0000","last_clean":"2024-09-22T03:08:09.785099+0000","last_became_active":"2024-09-22T03:08:05.504851+0000","last_became_peered":"2024-09-22T03:08:05.504851+0000","last_unstale":"2024-09-22T03:08:09.785099+0000","last_undegraded":"2024-09-22T03:08:09.785099+0000","last_fullsized":"2024-09-22T03:08:09.785099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.435689+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:08:06.435689+0000","last_peered":"2024-09-22T03:08:06.435689+0000","last_clean":"2024-09-22T03:08:06.435689+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:08:06.435689+0000","last_undegraded":"2024-09-22T03:08:06.435689+0000","last_fullsized":"2024-09-22T03:08:06.435689+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":211,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.443145+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:08:06.443145+0000","last_peered":"2024-09-22T03:08:06.443145+0000","last_clean":"2024-09-22T03:08:06.443145+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:08:06.443145+0000","last_undegraded":"2024-09-22T03:08:06.443145+0000","last_fullsized":"2024-09-22T03:08:06.443145+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"37'111","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:10.270493+0000","last_change":"2024-09-22T03:08:05.520963+0000","last_active":"2024-09-22T03:08:10.270493+0000","last_peered":"2024-09-22T03:08:10.270493+0000","last_clean":"2024-09-22T03:08:10.270493+0000","last_became_active":"2024-09-22T03:08:05.516106+0000","last_became_peered":"2024-09-22T03:08:05.516106+0000","last_unstale":"2024-09-22T03:08:10.270493+0000","last_undegraded":"2024-09-22T03:08:10.270493+0000","last_fullsized":"2024-09-22T03:08:10.270493+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.433385+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:08:06.433385+0000","last_peered":"2024-09-22T03:08:06.433385+0000","last_clean":"2024-09-22T03:08:06.433385+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:08:06.433385+0000","last_undegraded":"2024-09-22T03:08:06.433385+0000","last_fullsized":"2024-09-22T03:08:06.433385+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'119","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:11.077220+0000","last_change":"2024-09-22T03:08:05.491561+0000","last_active":"2024-09-22T03:08:11.077220+0000","last_peered":"2024-09-22T03:08:11.077220+0000","last_clean":"2024-09-22T03:08:11.077220+0000","last_became_active":"2024-09-22T03:08:05.486621+0000","last_became_peered":"2024-09-22T03:08:05.486621+0000","last_unstale":"2024-09-22T03:08:11.077220+0000","last_undegraded":"2024-09-22T03:08:11.077220+0000","last_fullsized":"2024-09-22T03:08:11.077220+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436271+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:08:06.436271+0000","last_peered":"2024-09-22T03:08:06.436271+0000","last_clean":"2024-09-22T03:08:06.436271+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:08:06.436271+0000","last_undegraded":"2024-09-22T03:08:06.436271+0000","last_fullsized":"2024-09-22T03:08:06.436271+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"37'71","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:10.652354+0000","last_change":"2024-09-22T03:08:05.491348+0000","last_active":"2024-09-22T03:08:10.652354+0000","last_peered":"2024-09-22T03:08:10.652354+0000","last_clean":"2024-09-22T03:08:10.652354+0000","last_became_active":"2024-09-22T03:08:05.485061+0000","last_became_peered":"2024-09-22T03:08:05.485061+0000","last_unstale":"2024-09-22T03:08:10.652354+0000","last_undegraded":"2024-09-22T03:08:10.652354+0000","last_fullsized":"2024-09-22T03:08:10.652354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.437885+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:08:06.437885+0000","last_peered":"2024-09-22T03:08:06.437885+0000","last_clean":"2024-09-22T03:08:06.437885+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:08:06.437885+0000","last_undegraded":"2024-09-22T03:08:06.437885+0000","last_fullsized":"2024-09-22T03:08:06.437885+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"37'87","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:11.686990+0000","last_change":"2024-09-22T03:08:05.501316+0000","last_active":"2024-09-22T03:08:11.686990+0000","last_peered":"2024-09-22T03:08:11.686990+0000","last_clean":"2024-09-22T03:08:11.686990+0000","last_became_active":"2024-09-22T03:08:05.496955+0000","last_became_peered":"2024-09-22T03:08:05.496955+0000","last_unstale":"2024-09-22T03:08:11.686990+0000","last_undegraded":"2024-09-22T03:08:11.686990+0000","last_fullsized":"2024-09-22T03:08:11.686990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436226+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:08:06.436226+0000","last_peered":"2024-09-22T03:08:06.436226+0000","last_clean":"2024-09-22T03:08:06.436226+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:08:06.436226+0000","last_undegraded":"2024-09-22T03:08:06.436226+0000","last_fullsized":"2024-09-22T03:08:06.436226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":14163968,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1729,"num_write_kb":13832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21417984,"data_stored":42835968,"data_compressed":2208537,"data_compressed_allocated":21417984,"data_compressed_original":42835968,"omap_allocated":0,"internal_metadata":0},"log_size":1713,"ondisk_log_size":1713,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93592,"kb_used_data":4292,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94278248,"statfs":{"total":96636764160,"available":96540925952,"internally_reserved":0,"allocated":4395008,"data_stored":8260133,"data_compressed":420169,"data_compressed_allocated":4075520,"data_compressed_original":8151040,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68512,"kb_used_data":5580,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94303328,"statfs":{"total":96636764160,"available":96566607872,"internally_reserved":0,"allocated":5713920,"data_stored":11365445,"data_compressed":579756,"data_compressed_allocated":5373952,"data_compressed_original":11239424,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93592,"kb_used_data":4296,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94278248,"statfs":{"total":96636764160,"available":96540925952,"internally_reserved":0,"allocated":4399104,"data_stored":8735813,"data_compressed":444221,"data_compressed_allocated":4059136,"data_compressed_original":8609792,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75748,"kb_used_data":4500,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94296092,"statfs":{"total":96636764160,"available":96559198208,"internally_reserved":0,"allocated":4608000,"data_stored":9161778,"data_compressed":465957,"data_compressed_allocated":4272128,"data_compressed_original":9035776,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5054464,"data_stored":10108928,"data_compressed":521020,"data_compressed_allocated":5054464,"data_compressed_original":10108928,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4972544,"data_stored":9945088,"data_compressed":512820,"data_compressed_allocated":4972544,"data_compressed_original":9945088,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6500352,"data_stored":13000704,"data_compressed":670351,"data_compressed_allocated":6500352,"data_compressed_original":13000704,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4890624,"data_stored":9781248,"data_compressed":504346,"data_compressed_allocated":4890624,"data_compressed_original":9781248,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:08:14.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 8 16 2764 2748 2.68339 2.49219 0.0526033 0.0464483 2024-09-22T03:08:15.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 9 15 3121 3106 2.69598 2.79688 0.046781 0.0462183 2024-09-22T03:08:15.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:15.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:15.767+0000 7f1b6b397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:15.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:15.773+0000 7f1b6b397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:16.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 10 16 3434 3418 2.67011 2.4375 0.0354319 0.0465545 2024-09-22T03:08:17.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 11 16 3772 3756 2.66741 2.64062 0.0177957 0.0467859 2024-09-22T03:08:17.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:18.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:18.061+0000 7f8e3970e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:18.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:18.066+0000 7f8e3970e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:18.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 12 16 4102 4086 2.65996 2.57812 0.0474705 0.0468693 2024-09-22T03:08:19.327 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:19.327 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:19.328 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:19.328 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:19.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:19.450+0000 7f54cac6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:19.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:19.461+0000 7f54cac6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:19.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 13 16 4449 4433 2.66386 2.71094 0.0342112 0.0468485 2024-09-22T03:08:19.528 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:19.528 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:19.528 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:19.528 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:19.528 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:19.528 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:19.528 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:19.528 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:19.528 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:19.529 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:19.529 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:19.529 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:19.532 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:19.532 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:19.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:19.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:19.677+0000 7efd4fb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:19.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:19.686+0000 7efd4fb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:19.704 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:19.704 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:19.705 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:19.705 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:19.705 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:19.705 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:19.705 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:19.705 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:19.705 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:19.705 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:19.705 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:19.705 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:19.708 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:19.709 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:19.709 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:19.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:19.833+0000 7f2f29797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:19.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:19.842+0000 7f2f29797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:19.878 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:19.878 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:19.878 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:19.878 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:19.878 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:19.879 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:19.879 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:19.879 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:19.879 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:19.879 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:19.879 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:19.879 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:19.881 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:19.882 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:19.882 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:20.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:20.007+0000 7f6d6c6d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:20.017+0000 7f6d6c6d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:20.046 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:20.046 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:20.049 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:20.049 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:20.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:20.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:20.370+0000 7efe70917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:20.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:20.376+0000 7efe70917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:20.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 14 16 4727 4711 2.62871 2.17188 0.0813872 0.0474312 2024-09-22T03:08:21.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 15 16 5087 5071 2.64094 2.8125 0.0492943 0.0472474 2024-09-22T03:08:22.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 16 16 5418 5402 2.63749 2.58594 0.089469 0.0473311 2024-09-22T03:08:22.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:22.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:22.670+0000 7f709bb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:22.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:22.676+0000 7f709bb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:23.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 17 16 5736 5720 2.62847 2.48438 0.0669653 0.0475121 2024-09-22T03:08:24.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 18 16 6062 6046 2.62393 2.54688 0.0556123 0.0475655 2024-09-22T03:08:24.795 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:24.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:24.912+0000 7f6763797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:24.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:24.918+0000 7f6763797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:25.050 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:25.050 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:25.050 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:08:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:25.174+0000 7f6ee92d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:25.184+0000 7f6ee92d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:25.426 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:08:25.426 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:08:25.443 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-22T03:08:24.734267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":42058291,"num_objects":637,"num_object_clones":0,"num_object_copies":1911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5201,"num_write_kb":42392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5146,"ondisk_log_size":5146,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":385572,"kb_used_data":58912,"kb_used_omap":0,"kb_used_meta":326592,"kb_avail":377101788,"statfs":{"total":386547056640,"available":386152230912,"internally_reserved":0,"allocated":60325888,"data_stored":119942881,"data_compressed":6165906,"data_compressed_allocated":58990592,"data_compressed_original":119455744,"omap_allocated":0,"internal_metadata":334430208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27303936,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3333,"num_write_kb":26664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002219"},"pg_stats":[{"pgid":"5.f","version":"37'319","reported_seq":332,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:21.639149+0000","last_change":"2024-09-22T03:08:05.527169+0000","last_active":"2024-09-22T03:08:21.639149+0000","last_peered":"2024-09-22T03:08:21.639149+0000","last_clean":"2024-09-22T03:08:21.639149+0000","last_became_active":"2024-09-22T03:08:05.504247+0000","last_became_peered":"2024-09-22T03:08:05.504247+0000","last_unstale":"2024-09-22T03:08:21.639149+0000","last_undegraded":"2024-09-22T03:08:21.639149+0000","last_fullsized":"2024-09-22T03:08:21.639149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"37'287","reported_seq":300,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:19.976562+0000","last_change":"2024-09-22T03:08:05.505551+0000","last_active":"2024-09-22T03:08:19.976562+0000","last_peered":"2024-09-22T03:08:19.976562+0000","last_clean":"2024-09-22T03:08:19.976562+0000","last_became_active":"2024-09-22T03:08:05.502164+0000","last_became_peered":"2024-09-22T03:08:05.502164+0000","last_unstale":"2024-09-22T03:08:19.976562+0000","last_undegraded":"2024-09-22T03:08:19.976562+0000","last_fullsized":"2024-09-22T03:08:19.976562+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"37'317","reported_seq":330,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:20.715523+0000","last_change":"2024-09-22T03:08:05.483440+0000","last_active":"2024-09-22T03:08:20.715523+0000","last_peered":"2024-09-22T03:08:20.715523+0000","last_clean":"2024-09-22T03:08:20.715523+0000","last_became_active":"2024-09-22T03:08:05.477343+0000","last_became_peered":"2024-09-22T03:08:05.477343+0000","last_unstale":"2024-09-22T03:08:20.715523+0000","last_undegraded":"2024-09-22T03:08:20.715523+0000","last_fullsized":"2024-09-22T03:08:20.715523+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2605056,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":2544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"37'359","reported_seq":372,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:21.723987+0000","last_change":"2024-09-22T03:08:05.485033+0000","last_active":"2024-09-22T03:08:21.723987+0000","last_peered":"2024-09-22T03:08:21.723987+0000","last_clean":"2024-09-22T03:08:21.723987+0000","last_became_active":"2024-09-22T03:08:05.480835+0000","last_became_peered":"2024-09-22T03:08:05.480835+0000","last_unstale":"2024-09-22T03:08:21.723987+0000","last_undegraded":"2024-09-22T03:08:21.723987+0000","last_fullsized":"2024-09-22T03:08:21.723987+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'319","reported_seq":332,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:20.426435+0000","last_change":"2024-09-22T03:08:05.530920+0000","last_active":"2024-09-22T03:08:20.426435+0000","last_peered":"2024-09-22T03:08:20.426435+0000","last_clean":"2024-09-22T03:08:20.426435+0000","last_became_active":"2024-09-22T03:08:05.527955+0000","last_became_peered":"2024-09-22T03:08:05.527955+0000","last_unstale":"2024-09-22T03:08:20.426435+0000","last_undegraded":"2024-09-22T03:08:20.426435+0000","last_fullsized":"2024-09-22T03:08:20.426435+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"37'279","reported_seq":292,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:21.511453+0000","last_change":"2024-09-22T03:08:05.534057+0000","last_active":"2024-09-22T03:08:21.511453+0000","last_peered":"2024-09-22T03:08:21.511453+0000","last_clean":"2024-09-22T03:08:21.511453+0000","last_became_active":"2024-09-22T03:08:05.529876+0000","last_became_peered":"2024-09-22T03:08:05.529876+0000","last_unstale":"2024-09-22T03:08:21.511453+0000","last_undegraded":"2024-09-22T03:08:21.511453+0000","last_fullsized":"2024-09-22T03:08:21.511453+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"37'311","reported_seq":324,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:21.694030+0000","last_change":"2024-09-22T03:08:05.523426+0000","last_active":"2024-09-22T03:08:21.694030+0000","last_peered":"2024-09-22T03:08:21.694030+0000","last_clean":"2024-09-22T03:08:21.694030+0000","last_became_active":"2024-09-22T03:08:05.517777+0000","last_became_peered":"2024-09-22T03:08:05.517777+0000","last_unstale":"2024-09-22T03:08:21.694030+0000","last_undegraded":"2024-09-22T03:08:21.694030+0000","last_fullsized":"2024-09-22T03:08:21.694030+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"37'359","reported_seq":372,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:20.358779+0000","last_change":"2024-09-22T03:08:05.507606+0000","last_active":"2024-09-22T03:08:20.358779+0000","last_peered":"2024-09-22T03:08:20.358779+0000","last_clean":"2024-09-22T03:08:20.358779+0000","last_became_active":"2024-09-22T03:08:05.500277+0000","last_became_peered":"2024-09-22T03:08:05.500277+0000","last_unstale":"2024-09-22T03:08:20.358779+0000","last_undegraded":"2024-09-22T03:08:20.358779+0000","last_fullsized":"2024-09-22T03:08:20.358779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"37'311","reported_seq":324,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:21.434643+0000","last_change":"2024-09-22T03:08:05.498406+0000","last_active":"2024-09-22T03:08:21.434643+0000","last_peered":"2024-09-22T03:08:21.434643+0000","last_clean":"2024-09-22T03:08:21.434643+0000","last_became_active":"2024-09-22T03:08:05.494764+0000","last_became_peered":"2024-09-22T03:08:05.494764+0000","last_unstale":"2024-09-22T03:08:21.434643+0000","last_undegraded":"2024-09-22T03:08:21.434643+0000","last_fullsized":"2024-09-22T03:08:21.434643+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432217+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:08:06.432217+0000","last_peered":"2024-09-22T03:08:06.432217+0000","last_clean":"2024-09-22T03:08:06.432217+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:08:06.432217+0000","last_undegraded":"2024-09-22T03:08:06.432217+0000","last_fullsized":"2024-09-22T03:08:06.432217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"37'359","reported_seq":372,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:21.676743+0000","last_change":"2024-09-22T03:08:05.502489+0000","last_active":"2024-09-22T03:08:21.676743+0000","last_peered":"2024-09-22T03:08:21.676743+0000","last_clean":"2024-09-22T03:08:21.676743+0000","last_became_active":"2024-09-22T03:08:05.493812+0000","last_became_peered":"2024-09-22T03:08:05.493812+0000","last_unstale":"2024-09-22T03:08:21.676743+0000","last_undegraded":"2024-09-22T03:08:21.676743+0000","last_fullsized":"2024-09-22T03:08:21.676743+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432497+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:08:06.432497+0000","last_peered":"2024-09-22T03:08:06.432497+0000","last_clean":"2024-09-22T03:08:06.432497+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:08:06.432497+0000","last_undegraded":"2024-09-22T03:08:06.432497+0000","last_fullsized":"2024-09-22T03:08:06.432497+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'351","reported_seq":364,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:20.955737+0000","last_change":"2024-09-22T03:08:05.492364+0000","last_active":"2024-09-22T03:08:20.955737+0000","last_peered":"2024-09-22T03:08:20.955737+0000","last_clean":"2024-09-22T03:08:20.955737+0000","last_became_active":"2024-09-22T03:08:05.483434+0000","last_became_peered":"2024-09-22T03:08:05.483434+0000","last_unstale":"2024-09-22T03:08:20.955737+0000","last_undegraded":"2024-09-22T03:08:20.955737+0000","last_fullsized":"2024-09-22T03:08:20.955737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432168+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:08:06.432168+0000","last_peered":"2024-09-22T03:08:06.432168+0000","last_clean":"2024-09-22T03:08:06.432168+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:08:06.432168+0000","last_undegraded":"2024-09-22T03:08:06.432168+0000","last_fullsized":"2024-09-22T03:08:06.432168+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"37'303","reported_seq":316,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:19.662501+0000","last_change":"2024-09-22T03:08:05.510228+0000","last_active":"2024-09-22T03:08:19.662501+0000","last_peered":"2024-09-22T03:08:19.662501+0000","last_clean":"2024-09-22T03:08:19.662501+0000","last_became_active":"2024-09-22T03:08:05.504851+0000","last_became_peered":"2024-09-22T03:08:05.504851+0000","last_unstale":"2024-09-22T03:08:19.662501+0000","last_undegraded":"2024-09-22T03:08:19.662501+0000","last_fullsized":"2024-09-22T03:08:19.662501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.435689+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:08:06.435689+0000","last_peered":"2024-09-22T03:08:06.435689+0000","last_clean":"2024-09-22T03:08:06.435689+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:08:06.435689+0000","last_undegraded":"2024-09-22T03:08:06.435689+0000","last_fullsized":"2024-09-22T03:08:06.435689+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":211,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.443145+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:08:06.443145+0000","last_peered":"2024-09-22T03:08:06.443145+0000","last_clean":"2024-09-22T03:08:06.443145+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:08:06.443145+0000","last_undegraded":"2024-09-22T03:08:06.443145+0000","last_fullsized":"2024-09-22T03:08:06.443145+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"37'287","reported_seq":300,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:20.502122+0000","last_change":"2024-09-22T03:08:05.520963+0000","last_active":"2024-09-22T03:08:20.502122+0000","last_peered":"2024-09-22T03:08:20.502122+0000","last_clean":"2024-09-22T03:08:20.502122+0000","last_became_active":"2024-09-22T03:08:05.516106+0000","last_became_peered":"2024-09-22T03:08:05.516106+0000","last_unstale":"2024-09-22T03:08:20.502122+0000","last_undegraded":"2024-09-22T03:08:20.502122+0000","last_fullsized":"2024-09-22T03:08:20.502122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.433385+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:08:06.433385+0000","last_peered":"2024-09-22T03:08:06.433385+0000","last_clean":"2024-09-22T03:08:06.433385+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:08:06.433385+0000","last_undegraded":"2024-09-22T03:08:06.433385+0000","last_fullsized":"2024-09-22T03:08:06.433385+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'311","reported_seq":324,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:20.123603+0000","last_change":"2024-09-22T03:08:05.491561+0000","last_active":"2024-09-22T03:08:20.123603+0000","last_peered":"2024-09-22T03:08:20.123603+0000","last_clean":"2024-09-22T03:08:20.123603+0000","last_became_active":"2024-09-22T03:08:05.486621+0000","last_became_peered":"2024-09-22T03:08:05.486621+0000","last_unstale":"2024-09-22T03:08:20.123603+0000","last_undegraded":"2024-09-22T03:08:20.123603+0000","last_fullsized":"2024-09-22T03:08:20.123603+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436271+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:08:06.436271+0000","last_peered":"2024-09-22T03:08:06.436271+0000","last_clean":"2024-09-22T03:08:06.436271+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:08:06.436271+0000","last_undegraded":"2024-09-22T03:08:06.436271+0000","last_fullsized":"2024-09-22T03:08:06.436271+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"37'279","reported_seq":292,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:20.537251+0000","last_change":"2024-09-22T03:08:05.491348+0000","last_active":"2024-09-22T03:08:20.537251+0000","last_peered":"2024-09-22T03:08:20.537251+0000","last_clean":"2024-09-22T03:08:20.537251+0000","last_became_active":"2024-09-22T03:08:05.485061+0000","last_became_peered":"2024-09-22T03:08:05.485061+0000","last_unstale":"2024-09-22T03:08:20.537251+0000","last_undegraded":"2024-09-22T03:08:20.537251+0000","last_fullsized":"2024-09-22T03:08:20.537251+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.437885+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:08:06.437885+0000","last_peered":"2024-09-22T03:08:06.437885+0000","last_clean":"2024-09-22T03:08:06.437885+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:08:06.437885+0000","last_undegraded":"2024-09-22T03:08:06.437885+0000","last_fullsized":"2024-09-22T03:08:06.437885+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"37'295","reported_seq":308,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:21.684026+0000","last_change":"2024-09-22T03:08:05.501316+0000","last_active":"2024-09-22T03:08:21.684026+0000","last_peered":"2024-09-22T03:08:21.684026+0000","last_clean":"2024-09-22T03:08:21.684026+0000","last_became_active":"2024-09-22T03:08:05.496955+0000","last_became_peered":"2024-09-22T03:08:05.496955+0000","last_unstale":"2024-09-22T03:08:21.684026+0000","last_undegraded":"2024-09-22T03:08:21.684026+0000","last_fullsized":"2024-09-22T03:08:21.684026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436226+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:08:06.436226+0000","last_peered":"2024-09-22T03:08:06.436226+0000","last_clean":"2024-09-22T03:08:06.436226+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:08:06.436226+0000","last_undegraded":"2024-09-22T03:08:06.436226+0000","last_fullsized":"2024-09-22T03:08:06.436226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":41467904,"num_objects":633,"num_object_clones":0,"num_object_copies":1899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5062,"num_write_kb":40496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62402560,"data_stored":124805120,"data_compressed":6441075,"data_compressed_allocated":62402560,"data_compressed_original":124805120,"omap_allocated":0,"internal_metadata":0},"log_size":5046,"ondisk_log_size":5046,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98800,"kb_used_data":13664,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94273040,"statfs":{"total":96636764160,"available":96535592960,"internally_reserved":0,"allocated":13991936,"data_stored":27453989,"data_compressed":1411258,"data_compressed_allocated":13672448,"data_compressed_original":27344896,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92732,"kb_used_data":17324,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94279108,"statfs":{"total":96636764160,"available":96541806592,"internally_reserved":0,"allocated":17739776,"data_stored":35417157,"data_compressed":1821684,"data_compressed_allocated":17399808,"data_compressed_original":35291136,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93580,"kb_used_data":12604,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94278260,"statfs":{"total":96636764160,"available":96540938240,"internally_reserved":0,"allocated":12906496,"data_stored":25750597,"data_compressed":1322792,"data_compressed_allocated":12566528,"data_compressed_original":25624576,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":100460,"kb_used_data":15320,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94271380,"statfs":{"total":96636764160,"available":96533893120,"internally_reserved":0,"allocated":15687680,"data_stored":31321138,"data_compressed":1610172,"data_compressed_allocated":15351808,"data_compressed_original":31195136,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16019456,"data_stored":32038912,"data_compressed":1653391,"data_compressed_allocated":16019456,"data_compressed_original":32038912,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13275136,"data_stored":26550272,"data_compressed":1370241,"data_compressed_allocated":13275136,"data_compressed_original":26550272,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18513920,"data_stored":37027840,"data_compressed":1911010,"data_compressed_allocated":18513920,"data_compressed_original":37027840,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14594048,"data_stored":29188096,"data_compressed":1506433,"data_compressed_allocated":14594048,"data_compressed_original":29188096,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:08:25.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 19 16 6396 6380 2.62315 2.60938 0.0402261 0.047579 2024-09-22T03:08:26.503 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:08:26.503175+0000 min lat: 0.00824185 max lat: 0.145421 avg lat: 0.0474533 2024-09-22T03:08:26.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:08:26.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 20 16 6753 6737 2.63144 2.78906 0.0225211 0.0474533 2024-09-22T03:08:27.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:27.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:27.182+0000 7ff64606c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:27.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:27.189+0000 7ff64606c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:27.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 21 16 7061 7045 2.6207 2.40625 0.0718088 0.0476336 2024-09-22T03:08:28.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 22 16 7397 7381 2.62089 2.625 0.0439634 0.0476218 2024-09-22T03:08:29.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:29.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:29.446+0000 7fdbaa42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:29.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:29.453+0000 7fdbaa42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:29.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 23 16 7702 7686 2.61053 2.38281 0.0767188 0.047788 2024-09-22T03:08:30.445 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:30.445 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:30.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:08:30.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 24 16 8033 8017 2.6095 2.58594 0.0288254 0.0478343 2024-09-22T03:08:30.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:30.565+0000 7f51a8757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:30.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:30.573+0000 7f51a8757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:30.789 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:08:30.789 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:08:30.804 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-22T03:08:30.735352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":55378483,"num_objects":840,"num_object_clones":0,"num_object_copies":2520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":6827,"num_write_kb":55400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6772,"ondisk_log_size":6772,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":423776,"kb_used_data":79068,"kb_used_omap":0,"kb_used_meta":344640,"kb_avail":377063584,"statfs":{"total":386547056640,"available":386113110016,"internally_reserved":0,"allocated":80965632,"data_stored":161222369,"data_compressed":8297403,"data_compressed_allocated":79630336,"data_compressed_original":160735232,"omap_allocated":0,"internal_metadata":352911360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27492352,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3356,"num_write_kb":26848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002208"},"pg_stats":[{"pgid":"5.f","version":"37'439","reported_seq":452,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:25.531953+0000","last_change":"2024-09-22T03:08:05.527169+0000","last_active":"2024-09-22T03:08:25.531953+0000","last_peered":"2024-09-22T03:08:25.531953+0000","last_clean":"2024-09-22T03:08:25.531953+0000","last_became_active":"2024-09-22T03:08:05.504247+0000","last_became_peered":"2024-09-22T03:08:05.504247+0000","last_unstale":"2024-09-22T03:08:25.531953+0000","last_undegraded":"2024-09-22T03:08:25.531953+0000","last_fullsized":"2024-09-22T03:08:25.531953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"37'439","reported_seq":452,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:25.548227+0000","last_change":"2024-09-22T03:08:05.505551+0000","last_active":"2024-09-22T03:08:25.548227+0000","last_peered":"2024-09-22T03:08:25.548227+0000","last_clean":"2024-09-22T03:08:25.548227+0000","last_became_active":"2024-09-22T03:08:05.502164+0000","last_became_peered":"2024-09-22T03:08:05.502164+0000","last_unstale":"2024-09-22T03:08:25.548227+0000","last_undegraded":"2024-09-22T03:08:25.548227+0000","last_fullsized":"2024-09-22T03:08:25.548227+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"37'423","reported_seq":436,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:24.927676+0000","last_change":"2024-09-22T03:08:05.483440+0000","last_active":"2024-09-22T03:08:24.927676+0000","last_peered":"2024-09-22T03:08:24.927676+0000","last_clean":"2024-09-22T03:08:24.927676+0000","last_became_active":"2024-09-22T03:08:05.477343+0000","last_became_peered":"2024-09-22T03:08:05.477343+0000","last_unstale":"2024-09-22T03:08:24.927676+0000","last_undegraded":"2024-09-22T03:08:24.927676+0000","last_fullsized":"2024-09-22T03:08:24.927676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"37'455","reported_seq":468,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:26.669009+0000","last_change":"2024-09-22T03:08:05.485033+0000","last_active":"2024-09-22T03:08:26.669009+0000","last_peered":"2024-09-22T03:08:26.669009+0000","last_clean":"2024-09-22T03:08:26.669009+0000","last_became_active":"2024-09-22T03:08:05.480835+0000","last_became_peered":"2024-09-22T03:08:05.480835+0000","last_unstale":"2024-09-22T03:08:26.669009+0000","last_undegraded":"2024-09-22T03:08:26.669009+0000","last_fullsized":"2024-09-22T03:08:26.669009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'391","reported_seq":404,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:24.884400+0000","last_change":"2024-09-22T03:08:05.530920+0000","last_active":"2024-09-22T03:08:24.884400+0000","last_peered":"2024-09-22T03:08:24.884400+0000","last_clean":"2024-09-22T03:08:24.884400+0000","last_became_active":"2024-09-22T03:08:05.527955+0000","last_became_peered":"2024-09-22T03:08:05.527955+0000","last_unstale":"2024-09-22T03:08:24.884400+0000","last_undegraded":"2024-09-22T03:08:24.884400+0000","last_fullsized":"2024-09-22T03:08:24.884400+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"37'391","reported_seq":404,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:26.183972+0000","last_change":"2024-09-22T03:08:05.534057+0000","last_active":"2024-09-22T03:08:26.183972+0000","last_peered":"2024-09-22T03:08:26.183972+0000","last_clean":"2024-09-22T03:08:26.183972+0000","last_became_active":"2024-09-22T03:08:05.529876+0000","last_became_peered":"2024-09-22T03:08:05.529876+0000","last_unstale":"2024-09-22T03:08:26.183972+0000","last_undegraded":"2024-09-22T03:08:26.183972+0000","last_fullsized":"2024-09-22T03:08:26.183972+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"37'479","reported_seq":492,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:26.727751+0000","last_change":"2024-09-22T03:08:05.523426+0000","last_active":"2024-09-22T03:08:26.727751+0000","last_peered":"2024-09-22T03:08:26.727751+0000","last_clean":"2024-09-22T03:08:26.727751+0000","last_became_active":"2024-09-22T03:08:05.517777+0000","last_became_peered":"2024-09-22T03:08:05.517777+0000","last_unstale":"2024-09-22T03:08:26.727751+0000","last_undegraded":"2024-09-22T03:08:26.727751+0000","last_fullsized":"2024-09-22T03:08:26.727751+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"37'431","reported_seq":444,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:24.653795+0000","last_change":"2024-09-22T03:08:05.507606+0000","last_active":"2024-09-22T03:08:24.653795+0000","last_peered":"2024-09-22T03:08:24.653795+0000","last_clean":"2024-09-22T03:08:24.653795+0000","last_became_active":"2024-09-22T03:08:05.500277+0000","last_became_peered":"2024-09-22T03:08:05.500277+0000","last_unstale":"2024-09-22T03:08:24.653795+0000","last_undegraded":"2024-09-22T03:08:24.653795+0000","last_fullsized":"2024-09-22T03:08:24.653795+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"37'447","reported_seq":460,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:26.636180+0000","last_change":"2024-09-22T03:08:05.498406+0000","last_active":"2024-09-22T03:08:26.636180+0000","last_peered":"2024-09-22T03:08:26.636180+0000","last_clean":"2024-09-22T03:08:26.636180+0000","last_became_active":"2024-09-22T03:08:05.494764+0000","last_became_peered":"2024-09-22T03:08:05.494764+0000","last_unstale":"2024-09-22T03:08:26.636180+0000","last_undegraded":"2024-09-22T03:08:26.636180+0000","last_fullsized":"2024-09-22T03:08:26.636180+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432217+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:08:06.432217+0000","last_peered":"2024-09-22T03:08:06.432217+0000","last_clean":"2024-09-22T03:08:06.432217+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:08:06.432217+0000","last_undegraded":"2024-09-22T03:08:06.432217+0000","last_fullsized":"2024-09-22T03:08:06.432217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"37'455","reported_seq":468,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:26.427806+0000","last_change":"2024-09-22T03:08:05.502489+0000","last_active":"2024-09-22T03:08:26.427806+0000","last_peered":"2024-09-22T03:08:26.427806+0000","last_clean":"2024-09-22T03:08:26.427806+0000","last_became_active":"2024-09-22T03:08:05.493812+0000","last_became_peered":"2024-09-22T03:08:05.493812+0000","last_unstale":"2024-09-22T03:08:26.427806+0000","last_undegraded":"2024-09-22T03:08:26.427806+0000","last_fullsized":"2024-09-22T03:08:26.427806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432497+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:08:06.432497+0000","last_peered":"2024-09-22T03:08:06.432497+0000","last_clean":"2024-09-22T03:08:06.432497+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:08:06.432497+0000","last_undegraded":"2024-09-22T03:08:06.432497+0000","last_fullsized":"2024-09-22T03:08:06.432497+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'407","reported_seq":420,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:26.547701+0000","last_change":"2024-09-22T03:08:05.492364+0000","last_active":"2024-09-22T03:08:26.547701+0000","last_peered":"2024-09-22T03:08:26.547701+0000","last_clean":"2024-09-22T03:08:26.547701+0000","last_became_active":"2024-09-22T03:08:05.483434+0000","last_became_peered":"2024-09-22T03:08:05.483434+0000","last_unstale":"2024-09-22T03:08:26.547701+0000","last_undegraded":"2024-09-22T03:08:26.547701+0000","last_fullsized":"2024-09-22T03:08:26.547701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432168+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:08:06.432168+0000","last_peered":"2024-09-22T03:08:06.432168+0000","last_clean":"2024-09-22T03:08:06.432168+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:08:06.432168+0000","last_undegraded":"2024-09-22T03:08:06.432168+0000","last_fullsized":"2024-09-22T03:08:06.432168+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"37'351","reported_seq":364,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:25.458103+0000","last_change":"2024-09-22T03:08:05.510228+0000","last_active":"2024-09-22T03:08:25.458103+0000","last_peered":"2024-09-22T03:08:25.458103+0000","last_clean":"2024-09-22T03:08:25.458103+0000","last_became_active":"2024-09-22T03:08:05.504851+0000","last_became_peered":"2024-09-22T03:08:05.504851+0000","last_unstale":"2024-09-22T03:08:25.458103+0000","last_undegraded":"2024-09-22T03:08:25.458103+0000","last_fullsized":"2024-09-22T03:08:25.458103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.435689+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:08:06.435689+0000","last_peered":"2024-09-22T03:08:06.435689+0000","last_clean":"2024-09-22T03:08:06.435689+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:08:06.435689+0000","last_undegraded":"2024-09-22T03:08:06.435689+0000","last_fullsized":"2024-09-22T03:08:06.435689+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":211,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.443145+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:08:06.443145+0000","last_peered":"2024-09-22T03:08:06.443145+0000","last_clean":"2024-09-22T03:08:06.443145+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:08:06.443145+0000","last_undegraded":"2024-09-22T03:08:06.443145+0000","last_fullsized":"2024-09-22T03:08:06.443145+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"37'367","reported_seq":380,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:25.611129+0000","last_change":"2024-09-22T03:08:05.520963+0000","last_active":"2024-09-22T03:08:25.611129+0000","last_peered":"2024-09-22T03:08:25.611129+0000","last_clean":"2024-09-22T03:08:25.611129+0000","last_became_active":"2024-09-22T03:08:05.516106+0000","last_became_peered":"2024-09-22T03:08:05.516106+0000","last_unstale":"2024-09-22T03:08:25.611129+0000","last_undegraded":"2024-09-22T03:08:25.611129+0000","last_fullsized":"2024-09-22T03:08:25.611129+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.433385+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:08:06.433385+0000","last_peered":"2024-09-22T03:08:06.433385+0000","last_clean":"2024-09-22T03:08:06.433385+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:08:06.433385+0000","last_undegraded":"2024-09-22T03:08:06.433385+0000","last_fullsized":"2024-09-22T03:08:06.433385+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'407","reported_seq":420,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:26.385168+0000","last_change":"2024-09-22T03:08:05.491561+0000","last_active":"2024-09-22T03:08:26.385168+0000","last_peered":"2024-09-22T03:08:26.385168+0000","last_clean":"2024-09-22T03:08:26.385168+0000","last_became_active":"2024-09-22T03:08:05.486621+0000","last_became_peered":"2024-09-22T03:08:05.486621+0000","last_unstale":"2024-09-22T03:08:26.385168+0000","last_undegraded":"2024-09-22T03:08:26.385168+0000","last_fullsized":"2024-09-22T03:08:26.385168+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436271+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:08:06.436271+0000","last_peered":"2024-09-22T03:08:06.436271+0000","last_clean":"2024-09-22T03:08:06.436271+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:08:06.436271+0000","last_undegraded":"2024-09-22T03:08:06.436271+0000","last_fullsized":"2024-09-22T03:08:06.436271+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"37'351","reported_seq":364,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:25.156819+0000","last_change":"2024-09-22T03:08:05.491348+0000","last_active":"2024-09-22T03:08:25.156819+0000","last_peered":"2024-09-22T03:08:25.156819+0000","last_clean":"2024-09-22T03:08:25.156819+0000","last_became_active":"2024-09-22T03:08:05.485061+0000","last_became_peered":"2024-09-22T03:08:05.485061+0000","last_unstale":"2024-09-22T03:08:25.156819+0000","last_undegraded":"2024-09-22T03:08:25.156819+0000","last_fullsized":"2024-09-22T03:08:25.156819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.437885+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:08:06.437885+0000","last_peered":"2024-09-22T03:08:06.437885+0000","last_clean":"2024-09-22T03:08:06.437885+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:08:06.437885+0000","last_undegraded":"2024-09-22T03:08:06.437885+0000","last_fullsized":"2024-09-22T03:08:06.437885+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"37'439","reported_seq":452,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:26.529905+0000","last_change":"2024-09-22T03:08:05.501316+0000","last_active":"2024-09-22T03:08:26.529905+0000","last_peered":"2024-09-22T03:08:26.529905+0000","last_clean":"2024-09-22T03:08:26.529905+0000","last_became_active":"2024-09-22T03:08:05.496955+0000","last_became_peered":"2024-09-22T03:08:05.496955+0000","last_unstale":"2024-09-22T03:08:26.529905+0000","last_undegraded":"2024-09-22T03:08:26.529905+0000","last_fullsized":"2024-09-22T03:08:26.529905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436226+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:08:06.436226+0000","last_peered":"2024-09-22T03:08:06.436226+0000","last_clean":"2024-09-22T03:08:06.436226+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:08:06.436226+0000","last_undegraded":"2024-09-22T03:08:06.436226+0000","last_fullsized":"2024-09-22T03:08:06.436226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6688,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82710528,"data_stored":165421056,"data_compressed":8538309,"data_compressed_allocated":82710528,"data_compressed_original":165421056,"omap_allocated":0,"internal_metadata":0},"log_size":6672,"ondisk_log_size":6672,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107648,"kb_used_data":18348,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94264192,"statfs":{"total":96636764160,"available":96526532608,"internally_reserved":0,"allocated":18788352,"data_stored":37046821,"data_compressed":1906591,"data_compressed_allocated":18468864,"data_compressed_original":36937728,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104436,"kb_used_data":23460,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94267404,"statfs":{"total":96636764160,"available":96529821696,"internally_reserved":0,"allocated":24023040,"data_stored":47983685,"data_compressed":2470566,"data_compressed_allocated":23683072,"data_compressed_original":47857664,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":101932,"kb_used_data":16796,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94269908,"statfs":{"total":96636764160,"available":96532385792,"internally_reserved":0,"allocated":17199104,"data_stored":34335813,"data_compressed":1766096,"data_compressed_allocated":16859136,"data_compressed_original":34209792,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":109760,"kb_used_data":20464,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94262080,"statfs":{"total":96636764160,"available":96524369920,"internally_reserved":0,"allocated":20955136,"data_stored":41856050,"data_compressed":2154150,"data_compressed_allocated":20619264,"data_compressed_original":41730048,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21348352,"data_stored":42696704,"data_compressed":2203714,"data_compressed_allocated":21348352,"data_compressed_original":42696704,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17465344,"data_stored":34930688,"data_compressed":1802970,"data_compressed_allocated":17465344,"data_compressed_original":34930688,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24727552,"data_stored":49455104,"data_compressed":2552701,"data_compressed_allocated":24727552,"data_compressed_original":49455104,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19169280,"data_stored":38338560,"data_compressed":1978924,"data_compressed_allocated":19169280,"data_compressed_original":38338560,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:08:31.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 25 16 8321 8305 2.59511 2.25 0.0337411 0.0481227 2024-09-22T03:08:31.560 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:31.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:31.691+0000 7f662422c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:31.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:31.698+0000 7f662422c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:32.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 26 16 8631 8615 2.58844 2.42188 0.0204917 0.0482375 2024-09-22T03:08:33.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 27 16 8986 8970 2.59528 2.77344 0.0167309 0.0480944 2024-09-22T03:08:33.843 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:33.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:33.960+0000 7f8ac0997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:33.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:33.967+0000 7f8ac0997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:34.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 28 16 9305 9289 2.59159 2.49219 0.0387644 0.0481888 2024-09-22T03:08:35.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 29 16 9625 9609 2.58842 2.5 0.0328583 0.0482391 2024-09-22T03:08:35.806 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:35.806 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:35.807 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:35.807 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:35.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:35.943+0000 7fe6cd517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:35.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:35.954+0000 7fe6cd517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:36.015 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:36.015 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:36.015 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:36.015 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:36.015 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:36.015 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:36.015 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:36.016 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:36.016 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:36.016 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:36.016 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:36.016 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:36.019 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:36.019 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:36.019 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:36.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:36.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:36.137+0000 7f52e6197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:36.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:36.149+0000 7f52e6197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:36.167 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:36.167 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:36.167 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:36.167 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:36.167 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:36.167 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:36.167 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:36.167 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:36.168 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:36.168 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:36.168 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:36.168 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:36.170 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:36.170 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:36.171 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:36.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:36.260+0000 7fb11cb4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:36.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:36.266+0000 7fb11cb4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:36.339+0000 7fadb5f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:36.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:36.351+0000 7fadb5f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:36.384 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:36.384 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:36.384 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:36.385 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:36.385 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:36.385 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:36.385 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:36.385 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:36.385 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:36.385 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:36.385 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:36.385 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:36.388 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:36.388 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:36.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:36.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 30 16 9921 9905 2.57922 2.3125 0.0687929 0.0484119 2024-09-22T03:08:36.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:36.532+0000 7f347f103640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:36.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:36.546+0000 7f347f103640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:36.566 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:36.567 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:36.567 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:36.567 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:36.567 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:36.567 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:36.567 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:36.567 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:36.567 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:36.567 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:36.567 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:36.567 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:36.570 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:36.570 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:37.504 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 31 16 10243 10227 2.57716 2.51562 0.0673288 0.0484797 2024-09-22T03:08:38.505 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 32 16 10550 10534 2.57157 2.39844 0.0521248 0.0485667 2024-09-22T03:08:38.505 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:38.642+0000 7fee51197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:38.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:38.647+0000 7fee51197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:39.505 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 33 16 10857 10841 2.56632 2.39844 0.0573106 0.0486538 2024-09-22T03:08:40.505 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 34 16 11153 11137 2.55885 2.3125 0.0230423 0.0488189 2024-09-22T03:08:40.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:40.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:40.891+0000 7f04e7797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:40.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:40.897+0000 7f04e7797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:41.505 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 35 16 11435 11419 2.54868 2.20312 0.0571981 0.048975 2024-09-22T03:08:41.572 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:41.572 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:41.572 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:41.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:41.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:41.699+0000 7f9cda84f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:41.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:41.708+0000 7f9cda84f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:41.781 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:41.781 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:41.781 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:41.781 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:41.784 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:41.784 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:41.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:41.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:41.909+0000 7f1643157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:41.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:41.920+0000 7f1643157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:41.940 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:41.940 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:41.941 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:41.941 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:41.941 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:41.941 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:41.941 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:41.941 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:41.941 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:41.941 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:41.941 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:41.941 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:41.943 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:41.944 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:41.944 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:42.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:42.064+0000 7f4ef94d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:42.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:42.074+0000 7f4ef94d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:42.096 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:42.096 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:42.097 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:42.097 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:42.097 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:42.097 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:42.097 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:42.097 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:42.097 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:42.097 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:42.097 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:42.097 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:42.099 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:42.100 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:42.100 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:42.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:42.226+0000 7f7f56d4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:42.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:42.235+0000 7f7f56d4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:42.269 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:42.269 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:42.269 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:42.269 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:42.270 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:42.270 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:42.270 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:42.270 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:42.270 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:42.270 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:42.270 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:42.270 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:42.272 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:42.272 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:42.505 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 36 16 11736 11720 2.5432 2.35156 0.0651939 0.0491009 2024-09-22T03:08:43.020 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:43.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:43.143+0000 7fd623f4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:43.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:43.148+0000 7fd623f4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:43.505 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 37 16 12012 11996 2.53274 2.15625 0.0318471 0.04931 2024-09-22T03:08:44.505 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 38 16 12319 12303 2.5292 2.39844 0.0439878 0.0493758 2024-09-22T03:08:45.239 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:45.364+0000 7f87a7b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:45.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:45.370+0000 7f87a7b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:45.505 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 39 16 12588 12572 2.51823 2.10156 0.0902919 0.0495904 2024-09-22T03:08:46.505 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:08:46.504879+0000 min lat: 0.00824185 max lat: 0.146614 avg lat: 0.0497623 2024-09-22T03:08:46.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:08:46.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 40 16 12864 12848 2.50917 2.15625 0.0277268 0.0497623 2024-09-22T03:08:47.273 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:47.274 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:47.274 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:47.274 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:47.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:47.398+0000 7fbc17a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:47.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:47.411+0000 7fbc167ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:47.463 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:47.463 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:47.463 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:47.463 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:47.467 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:47.468 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:47.468 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:47.505 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 41 16 13115 13099 2.4958 1.96094 0.0680306 0.0500405 2024-09-22T03:08:47.569 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:47.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:47.595+0000 7f1e2e717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:47.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:47.609+0000 7f1e2e717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:47.634 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:47.634 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:47.637 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:47.637 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:47.638 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:47.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:47.717+0000 7fe86d397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:47.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:47.723+0000 7fe86d397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:47.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:47.804+0000 7f32f4c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:47.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:47.815+0000 7f32f4c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:47.835 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:47.835 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:47.835 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:47.835 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:47.835 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:47.835 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:47.836 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:47.837 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:47.837 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:48.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:47.997+0000 7f25516b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:48.011+0000 7f25516b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:48.051 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:48.051 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:48.051 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:48.051 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:48.051 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:48.051 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:48.052 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:48.052 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:48.052 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:48.052 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:48.052 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:48.052 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:48.055 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:48.055 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:48.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 42 16 13363 13347 2.4825 1.9375 0.0528307 0.0502654 2024-09-22T03:08:49.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 43 16 13606 13590 2.46891 1.89844 0.0647328 0.0505819 2024-09-22T03:08:49.967 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:50.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:50.093+0000 7f73e1f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:50.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:50.098+0000 7f73e1f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:50.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 44 16 13873 13857 2.46021 2.08594 0.0459199 0.0507625 2024-09-22T03:08:51.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 45 16 14168 14152 2.45675 2.30469 0.0490378 0.0508443 2024-09-22T03:08:52.325 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:52.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:52.456+0000 7f0491e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:52.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:52.463+0000 7f0490c0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:52.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 46 16 14446 14430 2.45055 2.17188 0.0264347 0.0509716 2024-09-22T03:08:53.057 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:53.057 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:53.057 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:08:53.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:53.188+0000 7fa711aa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:53.199+0000 7fa711aa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:08:53.449 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:08:53.463 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-09-22T03:08:52.739322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":115876403,"num_objects":1765,"num_object_clones":0,"num_object_copies":5295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":14212,"num_write_kb":114480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14157,"ondisk_log_size":14157,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":539552,"kb_used_data":168480,"kb_used_omap":0,"kb_used_meta":371008,"kb_avail":376947808,"statfs":{"total":386547056640,"available":385994555392,"internally_reserved":0,"allocated":172523520,"data_stored":344338145,"data_compressed":17752719,"data_compressed_allocated":171188224,"data_compressed_original":343851008,"omap_allocated":0,"internal_metadata":379912192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29556736,"num_objects":452,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3608,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002158"},"pg_stats":[{"pgid":"5.f","version":"37'991","reported_seq":1004,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.570589+0000","last_change":"2024-09-22T03:08:05.527169+0000","last_active":"2024-09-22T03:08:51.570589+0000","last_peered":"2024-09-22T03:08:51.570589+0000","last_clean":"2024-09-22T03:08:51.570589+0000","last_became_active":"2024-09-22T03:08:05.504247+0000","last_became_peered":"2024-09-22T03:08:05.504247+0000","last_unstale":"2024-09-22T03:08:51.570589+0000","last_undegraded":"2024-09-22T03:08:51.570589+0000","last_fullsized":"2024-09-22T03:08:51.570589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"37'975","reported_seq":988,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:50.434776+0000","last_change":"2024-09-22T03:08:05.505551+0000","last_active":"2024-09-22T03:08:50.434776+0000","last_peered":"2024-09-22T03:08:50.434776+0000","last_clean":"2024-09-22T03:08:50.434776+0000","last_became_active":"2024-09-22T03:08:05.502164+0000","last_became_peered":"2024-09-22T03:08:05.502164+0000","last_unstale":"2024-09-22T03:08:50.434776+0000","last_undegraded":"2024-09-22T03:08:50.434776+0000","last_fullsized":"2024-09-22T03:08:50.434776+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"37'823","reported_seq":836,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:50.540128+0000","last_change":"2024-09-22T03:08:05.483440+0000","last_active":"2024-09-22T03:08:50.540128+0000","last_peered":"2024-09-22T03:08:50.540128+0000","last_clean":"2024-09-22T03:08:50.540128+0000","last_became_active":"2024-09-22T03:08:05.477343+0000","last_became_peered":"2024-09-22T03:08:05.477343+0000","last_unstale":"2024-09-22T03:08:50.540128+0000","last_undegraded":"2024-09-22T03:08:50.540128+0000","last_fullsized":"2024-09-22T03:08:50.540128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"37'882","reported_seq":895,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.729269+0000","last_change":"2024-09-22T03:08:05.485033+0000","last_active":"2024-09-22T03:08:51.729269+0000","last_peered":"2024-09-22T03:08:51.729269+0000","last_clean":"2024-09-22T03:08:51.729269+0000","last_became_active":"2024-09-22T03:08:05.480835+0000","last_became_peered":"2024-09-22T03:08:05.480835+0000","last_unstale":"2024-09-22T03:08:51.729269+0000","last_undegraded":"2024-09-22T03:08:51.729269+0000","last_fullsized":"2024-09-22T03:08:51.729269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7233536,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":883,"num_write_kb":7064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'871","reported_seq":884,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:50.376829+0000","last_change":"2024-09-22T03:08:05.530920+0000","last_active":"2024-09-22T03:08:50.376829+0000","last_peered":"2024-09-22T03:08:50.376829+0000","last_clean":"2024-09-22T03:08:50.376829+0000","last_became_active":"2024-09-22T03:08:05.527955+0000","last_became_peered":"2024-09-22T03:08:05.527955+0000","last_unstale":"2024-09-22T03:08:50.376829+0000","last_undegraded":"2024-09-22T03:08:50.376829+0000","last_fullsized":"2024-09-22T03:08:50.376829+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"37'743","reported_seq":756,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:50.352797+0000","last_change":"2024-09-22T03:08:05.534057+0000","last_active":"2024-09-22T03:08:50.352797+0000","last_peered":"2024-09-22T03:08:50.352797+0000","last_clean":"2024-09-22T03:08:50.352797+0000","last_became_active":"2024-09-22T03:08:05.529876+0000","last_became_peered":"2024-09-22T03:08:05.529876+0000","last_unstale":"2024-09-22T03:08:50.352797+0000","last_undegraded":"2024-09-22T03:08:50.352797+0000","last_fullsized":"2024-09-22T03:08:50.352797+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"37'935","reported_seq":948,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.727488+0000","last_change":"2024-09-22T03:08:05.523426+0000","last_active":"2024-09-22T03:08:51.727488+0000","last_peered":"2024-09-22T03:08:51.727488+0000","last_clean":"2024-09-22T03:08:51.727488+0000","last_became_active":"2024-09-22T03:08:05.517777+0000","last_became_peered":"2024-09-22T03:08:05.517777+0000","last_unstale":"2024-09-22T03:08:51.727488+0000","last_undegraded":"2024-09-22T03:08:51.727488+0000","last_fullsized":"2024-09-22T03:08:51.727488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"37'887","reported_seq":900,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:50.573473+0000","last_change":"2024-09-22T03:08:05.507606+0000","last_active":"2024-09-22T03:08:50.573473+0000","last_peered":"2024-09-22T03:08:50.573473+0000","last_clean":"2024-09-22T03:08:50.573473+0000","last_became_active":"2024-09-22T03:08:05.500277+0000","last_became_peered":"2024-09-22T03:08:05.500277+0000","last_unstale":"2024-09-22T03:08:50.573473+0000","last_undegraded":"2024-09-22T03:08:50.573473+0000","last_fullsized":"2024-09-22T03:08:50.573473+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"37'871","reported_seq":884,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.636376+0000","last_change":"2024-09-22T03:08:05.498406+0000","last_active":"2024-09-22T03:08:51.636376+0000","last_peered":"2024-09-22T03:08:51.636376+0000","last_clean":"2024-09-22T03:08:51.636376+0000","last_became_active":"2024-09-22T03:08:05.494764+0000","last_became_peered":"2024-09-22T03:08:05.494764+0000","last_unstale":"2024-09-22T03:08:51.636376+0000","last_undegraded":"2024-09-22T03:08:51.636376+0000","last_fullsized":"2024-09-22T03:08:51.636376+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432217+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:08:06.432217+0000","last_peered":"2024-09-22T03:08:06.432217+0000","last_clean":"2024-09-22T03:08:06.432217+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:08:06.432217+0000","last_undegraded":"2024-09-22T03:08:06.432217+0000","last_fullsized":"2024-09-22T03:08:06.432217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"37'911","reported_seq":924,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:50.985362+0000","last_change":"2024-09-22T03:08:05.502489+0000","last_active":"2024-09-22T03:08:50.985362+0000","last_peered":"2024-09-22T03:08:50.985362+0000","last_clean":"2024-09-22T03:08:50.985362+0000","last_became_active":"2024-09-22T03:08:05.493812+0000","last_became_peered":"2024-09-22T03:08:05.493812+0000","last_unstale":"2024-09-22T03:08:50.985362+0000","last_undegraded":"2024-09-22T03:08:50.985362+0000","last_fullsized":"2024-09-22T03:08:50.985362+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":911,"log_dups_size":0,"ondisk_log_size":911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432497+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:08:06.432497+0000","last_peered":"2024-09-22T03:08:06.432497+0000","last_clean":"2024-09-22T03:08:06.432497+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:08:06.432497+0000","last_undegraded":"2024-09-22T03:08:06.432497+0000","last_fullsized":"2024-09-22T03:08:06.432497+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'767","reported_seq":780,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:50.907023+0000","last_change":"2024-09-22T03:08:05.492364+0000","last_active":"2024-09-22T03:08:50.907023+0000","last_peered":"2024-09-22T03:08:50.907023+0000","last_clean":"2024-09-22T03:08:50.907023+0000","last_became_active":"2024-09-22T03:08:05.483434+0000","last_became_peered":"2024-09-22T03:08:05.483434+0000","last_unstale":"2024-09-22T03:08:50.907023+0000","last_undegraded":"2024-09-22T03:08:50.907023+0000","last_fullsized":"2024-09-22T03:08:50.907023+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432168+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:08:06.432168+0000","last_peered":"2024-09-22T03:08:06.432168+0000","last_clean":"2024-09-22T03:08:06.432168+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:08:06.432168+0000","last_undegraded":"2024-09-22T03:08:06.432168+0000","last_fullsized":"2024-09-22T03:08:06.432168+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"37'823","reported_seq":836,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:50.596919+0000","last_change":"2024-09-22T03:08:05.510228+0000","last_active":"2024-09-22T03:08:50.596919+0000","last_peered":"2024-09-22T03:08:50.596919+0000","last_clean":"2024-09-22T03:08:50.596919+0000","last_became_active":"2024-09-22T03:08:05.504851+0000","last_became_peered":"2024-09-22T03:08:05.504851+0000","last_unstale":"2024-09-22T03:08:50.596919+0000","last_undegraded":"2024-09-22T03:08:50.596919+0000","last_fullsized":"2024-09-22T03:08:50.596919+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.435689+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:08:06.435689+0000","last_peered":"2024-09-22T03:08:06.435689+0000","last_clean":"2024-09-22T03:08:06.435689+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:08:06.435689+0000","last_undegraded":"2024-09-22T03:08:06.435689+0000","last_fullsized":"2024-09-22T03:08:06.435689+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":211,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.443145+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:08:06.443145+0000","last_peered":"2024-09-22T03:08:06.443145+0000","last_clean":"2024-09-22T03:08:06.443145+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:08:06.443145+0000","last_undegraded":"2024-09-22T03:08:06.443145+0000","last_fullsized":"2024-09-22T03:08:06.443145+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"37'839","reported_seq":852,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:50.640001+0000","last_change":"2024-09-22T03:08:05.520963+0000","last_active":"2024-09-22T03:08:50.640001+0000","last_peered":"2024-09-22T03:08:50.640001+0000","last_clean":"2024-09-22T03:08:50.640001+0000","last_became_active":"2024-09-22T03:08:05.516106+0000","last_became_peered":"2024-09-22T03:08:05.516106+0000","last_unstale":"2024-09-22T03:08:50.640001+0000","last_undegraded":"2024-09-22T03:08:50.640001+0000","last_fullsized":"2024-09-22T03:08:50.640001+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.433385+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:08:06.433385+0000","last_peered":"2024-09-22T03:08:06.433385+0000","last_clean":"2024-09-22T03:08:06.433385+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:08:06.433385+0000","last_undegraded":"2024-09-22T03:08:06.433385+0000","last_fullsized":"2024-09-22T03:08:06.433385+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'904","reported_seq":917,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.297474+0000","last_change":"2024-09-22T03:08:05.491561+0000","last_active":"2024-09-22T03:08:51.297474+0000","last_peered":"2024-09-22T03:08:51.297474+0000","last_clean":"2024-09-22T03:08:51.297474+0000","last_became_active":"2024-09-22T03:08:05.486621+0000","last_became_peered":"2024-09-22T03:08:05.486621+0000","last_unstale":"2024-09-22T03:08:51.297474+0000","last_undegraded":"2024-09-22T03:08:51.297474+0000","last_fullsized":"2024-09-22T03:08:51.297474+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7413760,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":905,"num_write_kb":7240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436271+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:08:06.436271+0000","last_peered":"2024-09-22T03:08:06.436271+0000","last_clean":"2024-09-22T03:08:06.436271+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:08:06.436271+0000","last_undegraded":"2024-09-22T03:08:06.436271+0000","last_fullsized":"2024-09-22T03:08:06.436271+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"37'804","reported_seq":817,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:50.714717+0000","last_change":"2024-09-22T03:08:05.491348+0000","last_active":"2024-09-22T03:08:50.714717+0000","last_peered":"2024-09-22T03:08:50.714717+0000","last_clean":"2024-09-22T03:08:50.714717+0000","last_became_active":"2024-09-22T03:08:05.485061+0000","last_became_peered":"2024-09-22T03:08:05.485061+0000","last_unstale":"2024-09-22T03:08:50.714717+0000","last_undegraded":"2024-09-22T03:08:50.714717+0000","last_fullsized":"2024-09-22T03:08:50.714717+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6594560,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":6440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.437885+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:08:06.437885+0000","last_peered":"2024-09-22T03:08:06.437885+0000","last_clean":"2024-09-22T03:08:06.437885+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:08:06.437885+0000","last_undegraded":"2024-09-22T03:08:06.437885+0000","last_fullsized":"2024-09-22T03:08:06.437885+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"37'1031","reported_seq":1044,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.669837+0000","last_change":"2024-09-22T03:08:05.501316+0000","last_active":"2024-09-22T03:08:51.669837+0000","last_peered":"2024-09-22T03:08:51.669837+0000","last_clean":"2024-09-22T03:08:51.669837+0000","last_became_active":"2024-09-22T03:08:05.496955+0000","last_became_peered":"2024-09-22T03:08:05.496955+0000","last_unstale":"2024-09-22T03:08:51.669837+0000","last_undegraded":"2024-09-22T03:08:51.669837+0000","last_fullsized":"2024-09-22T03:08:51.669837+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436226+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:08:06.436226+0000","last_peered":"2024-09-22T03:08:06.436226+0000","last_clean":"2024-09-22T03:08:06.436226+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:08:06.436226+0000","last_undegraded":"2024-09-22T03:08:06.436226+0000","last_fullsized":"2024-09-22T03:08:06.436226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":115286016,"num_objects":1761,"num_object_clones":0,"num_object_copies":5283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14073,"num_write_kb":112584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":173834240,"data_stored":347668480,"data_compressed":17948787,"data_compressed_allocated":173834240,"data_compressed_original":347668480,"omap_allocated":0,"internal_metadata":0},"log_size":14057,"ondisk_log_size":14057,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":150456,"kb_used_data":38952,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94221384,"statfs":{"total":96636764160,"available":96482697216,"internally_reserved":0,"allocated":39886848,"data_stored":79243813,"data_compressed":4085464,"data_compressed_allocated":39567360,"data_compressed_original":79134720,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":138836,"kb_used_data":49540,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94233004,"statfs":{"total":96636764160,"available":96494596096,"internally_reserved":0,"allocated":50728960,"data_stored":101395525,"data_compressed":5228525,"data_compressed_allocated":50388992,"data_compressed_original":101269504,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124892,"kb_used_data":35596,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94246948,"statfs":{"total":96636764160,"available":96508874752,"internally_reserved":0,"allocated":36450304,"data_stored":72838213,"data_compressed":3754195,"data_compressed_allocated":36110336,"data_compressed_original":72712192,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125368,"kb_used_data":44392,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94246472,"statfs":{"total":96636764160,"available":96508387328,"internally_reserved":0,"allocated":45457408,"data_stored":90860594,"data_compressed":4684535,"data_compressed_allocated":45121536,"data_compressed_original":90734592,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45735936,"data_stored":91471872,"data_compressed":4722255,"data_compressed_allocated":45735936,"data_compressed_original":91471872,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36708352,"data_stored":73416704,"data_compressed":3790223,"data_compressed_allocated":36708352,"data_compressed_original":73416704,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51265536,"data_stored":102531072,"data_compressed":5293317,"data_compressed_allocated":51265536,"data_compressed_original":102531072,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40124416,"data_stored":80248832,"data_compressed":4142992,"data_compressed_allocated":40124416,"data_compressed_original":80248832,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:08:53.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 47 16 14685 14669 2.43813 1.86719 0.0359358 0.0511839 2024-09-22T03:08:54.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 48 16 14957 14941 2.43161 2.125 0.0317855 0.0513823 2024-09-22T03:08:54.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:54.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:54.709+0000 7f906c157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:54.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:54.715+0000 7f906c157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:55.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 49 16 15210 15194 2.42232 1.97656 0.0355909 0.0515826 2024-09-22T03:08:56.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 50 16 15461 15445 2.41309 1.96094 0.0680343 0.0517555 2024-09-22T03:08:56.867 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:56.982+0000 7f847ff17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:56.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:56.988+0000 7f847ff17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:57.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 51 16 15724 15708 2.40605 2.05469 0.0686533 0.0519137 2024-09-22T03:08:58.465 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:58.465 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:58.466 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:58.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:58.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 52 16 15986 15970 2.39914 2.04688 0.0721619 0.0520434 2024-09-22T03:08:58.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:58.587+0000 7fa5bb197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:58.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:58.598+0000 7fa5bb197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:58.683 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:58.683 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:58.683 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:58.683 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:58.683 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:58.683 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:58.683 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:58.683 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:58.684 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:58.684 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:58.684 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:58.684 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:58.686 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:58.687 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:58.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:58.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:58.851+0000 7f937d8b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:58.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:58.863+0000 7f937d8b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:58.894 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:58.896 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:58.897 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:58.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:59.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:59.024+0000 7f7841c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:59.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:59.033+0000 7f7841c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:59.048 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:59.048 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:59.048 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:59.048 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:59.048 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:59.049 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:59.049 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:59.049 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:59.049 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:59.049 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:59.049 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:59.049 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:59.051 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:59.052 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:59.052 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:59.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:59.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:59.202+0000 7f99c5d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:59.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:59.215+0000 7f99c5d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:08:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:08:59.237 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:59.237 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:59.244+0000 7efe7e8d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:59.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:08:59.249+0000 7efe7e8d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:59.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 53 16 16242 16226 2.39161 2 0.0204427 0.0522161 2024-09-22T03:09:00.506 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 54 15 16517 16502 2.38725 2.15625 0.0564828 0.0523285 2024-09-22T03:09:01.436 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:01.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 55 16 16792 16776 2.38276 2.14062 0.0409611 0.0524269 2024-09-22T03:09:01.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:01.573+0000 7f85c442c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:01.578+0000 7f85c442c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:02.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 56 16 17070 17054 2.37899 2.17188 0.0644336 0.0525007 2024-09-22T03:09:03.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 57 16 17334 17318 2.37344 2.0625 0.0566818 0.0526283 2024-09-22T03:09:03.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:03.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:03.815+0000 7f75dc06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:03.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:03.821+0000 7f75dc06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:04.238 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:04.239 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:04.239 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:04.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:04.372+0000 7f677062c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:04.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:04.380+0000 7f677062c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:04.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 58 15 17582 17567 2.36605 1.94531 0.0810024 0.0527935 2024-09-22T03:09:04.638 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:09:04.638 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:09:04.654 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-22T03:09:02.741070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137658931,"num_objects":2097,"num_object_clones":0,"num_object_copies":6291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":16871,"num_write_kb":135752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16816,"ondisk_log_size":16816,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":567072,"kb_used_data":200160,"kb_used_omap":0,"kb_used_meta":366848,"kb_avail":376920288,"statfs":{"total":386547056640,"available":385966374912,"internally_reserved":0,"allocated":204963840,"data_stored":409218785,"data_compressed":21102879,"data_compressed_allocated":203628544,"data_compressed_original":408731648,"omap_allocated":0,"internal_metadata":375652352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":32137216,"num_objects":491,"num_object_clones":0,"num_object_copies":1473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3923,"num_write_kb":31384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002042"},"pg_stats":[{"pgid":"5.f","version":"37'1255","reported_seq":1268,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:01.193170+0000","last_change":"2024-09-22T03:08:05.527169+0000","last_active":"2024-09-22T03:09:01.193170+0000","last_peered":"2024-09-22T03:09:01.193170+0000","last_clean":"2024-09-22T03:09:01.193170+0000","last_became_active":"2024-09-22T03:08:05.504247+0000","last_became_peered":"2024-09-22T03:08:05.504247+0000","last_unstale":"2024-09-22T03:09:01.193170+0000","last_undegraded":"2024-09-22T03:09:01.193170+0000","last_fullsized":"2024-09-22T03:09:01.193170+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1256,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"37'1119","reported_seq":1132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:00.359334+0000","last_change":"2024-09-22T03:08:05.505551+0000","last_active":"2024-09-22T03:09:00.359334+0000","last_peered":"2024-09-22T03:09:00.359334+0000","last_clean":"2024-09-22T03:09:00.359334+0000","last_became_active":"2024-09-22T03:08:05.502164+0000","last_became_peered":"2024-09-22T03:08:05.502164+0000","last_unstale":"2024-09-22T03:09:00.359334+0000","last_undegraded":"2024-09-22T03:09:00.359334+0000","last_fullsized":"2024-09-22T03:09:00.359334+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"37'1047","reported_seq":1060,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:00.419199+0000","last_change":"2024-09-22T03:08:05.483440+0000","last_active":"2024-09-22T03:09:00.419199+0000","last_peered":"2024-09-22T03:09:00.419199+0000","last_clean":"2024-09-22T03:09:00.419199+0000","last_became_active":"2024-09-22T03:08:05.477343+0000","last_became_peered":"2024-09-22T03:08:05.477343+0000","last_unstale":"2024-09-22T03:09:00.419199+0000","last_undegraded":"2024-09-22T03:09:00.419199+0000","last_fullsized":"2024-09-22T03:09:00.419199+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"37'1015","reported_seq":1028,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:01.363069+0000","last_change":"2024-09-22T03:08:05.485033+0000","last_active":"2024-09-22T03:09:01.363069+0000","last_peered":"2024-09-22T03:09:01.363069+0000","last_clean":"2024-09-22T03:09:01.363069+0000","last_became_active":"2024-09-22T03:08:05.480835+0000","last_became_peered":"2024-09-22T03:08:05.480835+0000","last_unstale":"2024-09-22T03:09:01.363069+0000","last_undegraded":"2024-09-22T03:09:01.363069+0000","last_fullsized":"2024-09-22T03:09:01.363069+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1016,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'975","reported_seq":988,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:00.715425+0000","last_change":"2024-09-22T03:08:05.530920+0000","last_active":"2024-09-22T03:09:00.715425+0000","last_peered":"2024-09-22T03:09:00.715425+0000","last_clean":"2024-09-22T03:09:00.715425+0000","last_became_active":"2024-09-22T03:08:05.527955+0000","last_became_peered":"2024-09-22T03:08:05.527955+0000","last_unstale":"2024-09-22T03:09:00.715425+0000","last_undegraded":"2024-09-22T03:09:00.715425+0000","last_fullsized":"2024-09-22T03:09:00.715425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"37'927","reported_seq":940,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:01.630624+0000","last_change":"2024-09-22T03:08:05.534057+0000","last_active":"2024-09-22T03:09:01.630624+0000","last_peered":"2024-09-22T03:09:01.630624+0000","last_clean":"2024-09-22T03:09:01.630624+0000","last_became_active":"2024-09-22T03:08:05.529876+0000","last_became_peered":"2024-09-22T03:08:05.529876+0000","last_unstale":"2024-09-22T03:09:01.630624+0000","last_undegraded":"2024-09-22T03:09:01.630624+0000","last_fullsized":"2024-09-22T03:09:01.630624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"37'1111","reported_seq":1124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:01.407270+0000","last_change":"2024-09-22T03:08:05.523426+0000","last_active":"2024-09-22T03:09:01.407270+0000","last_peered":"2024-09-22T03:09:01.407270+0000","last_clean":"2024-09-22T03:09:01.407270+0000","last_became_active":"2024-09-22T03:08:05.517777+0000","last_became_peered":"2024-09-22T03:08:05.517777+0000","last_unstale":"2024-09-22T03:09:01.407270+0000","last_undegraded":"2024-09-22T03:09:01.407270+0000","last_fullsized":"2024-09-22T03:09:01.407270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1111,"log_dups_size":0,"ondisk_log_size":1111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"37'991","reported_seq":1004,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:00.116158+0000","last_change":"2024-09-22T03:08:05.507606+0000","last_active":"2024-09-22T03:09:00.116158+0000","last_peered":"2024-09-22T03:09:00.116158+0000","last_clean":"2024-09-22T03:09:00.116158+0000","last_became_active":"2024-09-22T03:08:05.500277+0000","last_became_peered":"2024-09-22T03:08:05.500277+0000","last_unstale":"2024-09-22T03:09:00.116158+0000","last_undegraded":"2024-09-22T03:09:00.116158+0000","last_fullsized":"2024-09-22T03:09:00.116158+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"37'1031","reported_seq":1044,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:01.572573+0000","last_change":"2024-09-22T03:08:05.498406+0000","last_active":"2024-09-22T03:09:01.572573+0000","last_peered":"2024-09-22T03:09:01.572573+0000","last_clean":"2024-09-22T03:09:01.572573+0000","last_became_active":"2024-09-22T03:08:05.494764+0000","last_became_peered":"2024-09-22T03:08:05.494764+0000","last_unstale":"2024-09-22T03:09:01.572573+0000","last_undegraded":"2024-09-22T03:09:01.572573+0000","last_fullsized":"2024-09-22T03:09:01.572573+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432217+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:08:06.432217+0000","last_peered":"2024-09-22T03:08:06.432217+0000","last_clean":"2024-09-22T03:08:06.432217+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:08:06.432217+0000","last_undegraded":"2024-09-22T03:08:06.432217+0000","last_fullsized":"2024-09-22T03:08:06.432217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"37'1031","reported_seq":1044,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:01.147223+0000","last_change":"2024-09-22T03:08:05.502489+0000","last_active":"2024-09-22T03:09:01.147223+0000","last_peered":"2024-09-22T03:09:01.147223+0000","last_clean":"2024-09-22T03:09:01.147223+0000","last_became_active":"2024-09-22T03:08:05.493812+0000","last_became_peered":"2024-09-22T03:08:05.493812+0000","last_unstale":"2024-09-22T03:09:01.147223+0000","last_undegraded":"2024-09-22T03:09:01.147223+0000","last_fullsized":"2024-09-22T03:09:01.147223+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432497+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:08:06.432497+0000","last_peered":"2024-09-22T03:08:06.432497+0000","last_clean":"2024-09-22T03:08:06.432497+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:08:06.432497+0000","last_undegraded":"2024-09-22T03:08:06.432497+0000","last_fullsized":"2024-09-22T03:08:06.432497+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'911","reported_seq":924,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:01.538554+0000","last_change":"2024-09-22T03:08:05.492364+0000","last_active":"2024-09-22T03:09:01.538554+0000","last_peered":"2024-09-22T03:09:01.538554+0000","last_clean":"2024-09-22T03:09:01.538554+0000","last_became_active":"2024-09-22T03:08:05.483434+0000","last_became_peered":"2024-09-22T03:08:05.483434+0000","last_unstale":"2024-09-22T03:09:01.538554+0000","last_undegraded":"2024-09-22T03:09:01.538554+0000","last_fullsized":"2024-09-22T03:09:01.538554+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":911,"log_dups_size":0,"ondisk_log_size":911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432168+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:08:06.432168+0000","last_peered":"2024-09-22T03:08:06.432168+0000","last_clean":"2024-09-22T03:08:06.432168+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:08:06.432168+0000","last_undegraded":"2024-09-22T03:08:06.432168+0000","last_fullsized":"2024-09-22T03:08:06.432168+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"37'984","reported_seq":997,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:00.662365+0000","last_change":"2024-09-22T03:08:05.510228+0000","last_active":"2024-09-22T03:09:00.662365+0000","last_peered":"2024-09-22T03:09:00.662365+0000","last_clean":"2024-09-22T03:09:00.662365+0000","last_became_active":"2024-09-22T03:08:05.504851+0000","last_became_peered":"2024-09-22T03:08:05.504851+0000","last_unstale":"2024-09-22T03:09:00.662365+0000","last_undegraded":"2024-09-22T03:09:00.662365+0000","last_fullsized":"2024-09-22T03:09:00.662365+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8069120,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":985,"num_write_kb":7880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.435689+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:08:06.435689+0000","last_peered":"2024-09-22T03:08:06.435689+0000","last_clean":"2024-09-22T03:08:06.435689+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:08:06.435689+0000","last_undegraded":"2024-09-22T03:08:06.435689+0000","last_fullsized":"2024-09-22T03:08:06.435689+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":211,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.443145+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:08:06.443145+0000","last_peered":"2024-09-22T03:08:06.443145+0000","last_clean":"2024-09-22T03:08:06.443145+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:08:06.443145+0000","last_undegraded":"2024-09-22T03:08:06.443145+0000","last_fullsized":"2024-09-22T03:08:06.443145+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"37'1021","reported_seq":1034,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:00.727388+0000","last_change":"2024-09-22T03:08:05.520963+0000","last_active":"2024-09-22T03:09:00.727388+0000","last_peered":"2024-09-22T03:09:00.727388+0000","last_clean":"2024-09-22T03:09:00.727388+0000","last_became_active":"2024-09-22T03:08:05.516106+0000","last_became_peered":"2024-09-22T03:08:05.516106+0000","last_unstale":"2024-09-22T03:09:00.727388+0000","last_undegraded":"2024-09-22T03:09:00.727388+0000","last_fullsized":"2024-09-22T03:09:00.727388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8372224,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1022,"num_write_kb":8176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.433385+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:08:06.433385+0000","last_peered":"2024-09-22T03:08:06.433385+0000","last_clean":"2024-09-22T03:08:06.433385+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:08:06.433385+0000","last_undegraded":"2024-09-22T03:08:06.433385+0000","last_fullsized":"2024-09-22T03:08:06.433385+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'1103","reported_seq":1116,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:01.194319+0000","last_change":"2024-09-22T03:08:05.491561+0000","last_active":"2024-09-22T03:09:01.194319+0000","last_peered":"2024-09-22T03:09:01.194319+0000","last_clean":"2024-09-22T03:09:01.194319+0000","last_became_active":"2024-09-22T03:08:05.486621+0000","last_became_peered":"2024-09-22T03:08:05.486621+0000","last_unstale":"2024-09-22T03:09:01.194319+0000","last_undegraded":"2024-09-22T03:09:01.194319+0000","last_fullsized":"2024-09-22T03:09:01.194319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1103,"log_dups_size":0,"ondisk_log_size":1103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1104,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436271+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:08:06.436271+0000","last_peered":"2024-09-22T03:08:06.436271+0000","last_clean":"2024-09-22T03:08:06.436271+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:08:06.436271+0000","last_undegraded":"2024-09-22T03:08:06.436271+0000","last_fullsized":"2024-09-22T03:08:06.436271+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"37'1023","reported_seq":1036,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:00.594817+0000","last_change":"2024-09-22T03:08:05.491348+0000","last_active":"2024-09-22T03:09:00.594817+0000","last_peered":"2024-09-22T03:09:00.594817+0000","last_clean":"2024-09-22T03:09:00.594817+0000","last_became_active":"2024-09-22T03:08:05.485061+0000","last_became_peered":"2024-09-22T03:08:05.485061+0000","last_unstale":"2024-09-22T03:09:00.594817+0000","last_undegraded":"2024-09-22T03:09:00.594817+0000","last_fullsized":"2024-09-22T03:09:00.594817+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.437885+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:08:06.437885+0000","last_peered":"2024-09-22T03:08:06.437885+0000","last_clean":"2024-09-22T03:08:06.437885+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:08:06.437885+0000","last_undegraded":"2024-09-22T03:08:06.437885+0000","last_fullsized":"2024-09-22T03:08:06.437885+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"37'1172","reported_seq":1185,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:01.723079+0000","last_change":"2024-09-22T03:08:05.501316+0000","last_active":"2024-09-22T03:09:01.723079+0000","last_peered":"2024-09-22T03:09:01.723079+0000","last_clean":"2024-09-22T03:09:01.723079+0000","last_became_active":"2024-09-22T03:08:05.496955+0000","last_became_peered":"2024-09-22T03:08:05.496955+0000","last_unstale":"2024-09-22T03:09:01.723079+0000","last_undegraded":"2024-09-22T03:09:01.723079+0000","last_fullsized":"2024-09-22T03:09:01.723079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1172,"log_dups_size":0,"ondisk_log_size":1172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9609216,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":9384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436226+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:08:06.436226+0000","last_peered":"2024-09-22T03:08:06.436226+0000","last_clean":"2024-09-22T03:08:06.436226+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:08:06.436226+0000","last_undegraded":"2024-09-22T03:08:06.436226+0000","last_fullsized":"2024-09-22T03:08:06.436226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":137068544,"num_objects":2093,"num_object_clones":0,"num_object_copies":6279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16732,"num_write_kb":133856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":206176256,"data_stored":412352512,"data_compressed":21288795,"data_compressed_allocated":206176256,"data_compressed_original":412352512,"omap_allocated":0,"internal_metadata":0},"log_size":16716,"ondisk_log_size":16716,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673244,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149536,"kb_used_data":46352,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94222304,"statfs":{"total":96636764160,"available":96483639296,"internally_reserved":0,"allocated":47464448,"data_stored":94399013,"data_compressed":4868014,"data_compressed_allocated":47144960,"data_compressed_original":94289920,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673244,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139796,"kb_used_data":58820,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94232044,"statfs":{"total":96636764160,"available":96493613056,"internally_reserved":0,"allocated":60231680,"data_stored":120400965,"data_compressed":6209885,"data_compressed_allocated":59891712,"data_compressed_original":120274944,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673244,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135076,"kb_used_data":41620,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94236764,"statfs":{"total":96636764160,"available":96498446336,"internally_reserved":0,"allocated":42618880,"data_stored":85175365,"data_compressed":4391233,"data_compressed_allocated":42278912,"data_compressed_original":85049344,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142664,"kb_used_data":53368,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94229176,"statfs":{"total":96636764160,"available":96490676224,"internally_reserved":0,"allocated":54648832,"data_stored":109243442,"data_compressed":5633747,"data_compressed_allocated":54312960,"data_compressed_original":109117440,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":54992896,"data_stored":109985792,"data_compressed":5678235,"data_compressed_allocated":54992896,"data_compressed_original":109985792,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42778624,"data_stored":85557248,"data_compressed":4417109,"data_compressed_allocated":42778624,"data_compressed_original":85557248,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":60731392,"data_stored":121462784,"data_compressed":6270870,"data_compressed_allocated":60731392,"data_compressed_original":121462784,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":47673344,"data_stored":95346688,"data_compressed":4922581,"data_compressed_allocated":47673344,"data_compressed_original":95346688,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:05.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 59 16 17860 17844 2.36263 2.16406 0.0369105 0.0528872 2024-09-22T03:09:06.056 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:06.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:06.197+0000 7fe198f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:06.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:06.204+0000 7fe198f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:06.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:09:06.506499+0000 min lat: 0.00824185 max lat: 0.17118 avg lat: 0.0530422 2024-09-22T03:09:06.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:09:06.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 60 16 18103 18087 2.35489 1.89844 0.0243089 0.0530422 2024-09-22T03:09:07.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 61 16 18354 18338 2.34843 1.96094 0.100405 0.0531679 2024-09-22T03:09:08.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:08.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 62 16 18603 18587 2.34192 1.94531 0.0829017 0.0533226 2024-09-22T03:09:08.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:08.571+0000 7f8a96e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:08.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:08.577+0000 7f8a96e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:09.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 63 16 18859 18843 2.33649 2 0.0595411 0.053471 2024-09-22T03:09:09.656 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:09.657 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:09.657 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:09.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:09.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:09.805+0000 7f2d1ccd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:09.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:09.816+0000 7f2d1ccd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:09.846 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:09.846 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:09.846 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:09.846 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:09.846 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:09.846 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:09.846 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:09.846 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:09.846 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:09.846 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:09.847 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:09.847 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:09.851 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:09.852 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:09.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:09.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:09.976+0000 7f1a85557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:09.985+0000 7f1a85557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:10.008 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:10.008 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:10.009 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:10.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:10.156+0000 7f156e157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:10.166+0000 7f156e157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:10.185 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:10.185 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:10.186 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:10.186 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:10.186 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:10.186 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:10.186 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:10.186 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:10.186 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:10.186 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:10.186 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:10.186 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:10.189 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:10.189 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:10.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:10.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:10.313+0000 7fa1c5d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:10.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:10.326+0000 7fa1c5d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:10.348 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:10.350 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:10.351 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:10.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 64 16 19137 19121 2.33392 2.17188 0.0227797 0.0535329 2024-09-22T03:09:10.731 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:10.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:10.856+0000 7fe83b357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:10.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:10.861+0000 7fe83b357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:11.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 65 16 19396 19380 2.32914 2.02344 0.0746152 0.0536371 2024-09-22T03:09:12.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 66 16 19667 19651 2.32592 2.11719 0.0246076 0.0537191 2024-09-22T03:09:13.101 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:13.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:13.220+0000 7f561fb57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:13.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:13.226+0000 7f561fb57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:13.507 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 67 16 19932 19916 2.32211 2.07031 0.0479251 0.0538037 2024-09-22T03:09:14.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 68 16 20192 20176 2.31783 2.03125 0.0432887 0.0539081 2024-09-22T03:09:15.343 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:15.351 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:15.352 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:15.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:15.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:15.463+0000 7f18962b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:15.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:15.470+0000 7f18962b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:15.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 69 16 20437 20421 2.31197 1.91406 0.0273216 0.0540265 2024-09-22T03:09:15.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:15.525+0000 7f08fb8d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:15.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:15.533+0000 7f08fb8d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:09:15.782 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:09:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-22T03:09:14.743153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":159228467,"num_objects":2426,"num_object_clones":0,"num_object_copies":7278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":19504,"num_write_kb":156816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19449,"ondisk_log_size":19449,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":598428,"kb_used_data":231512,"kb_used_omap":0,"kb_used_meta":366848,"kb_avail":376888932,"statfs":{"total":386547056640,"available":385934266368,"internally_reserved":0,"allocated":237068288,"data_stored":473427681,"data_compressed":24418353,"data_compressed_allocated":235732992,"data_compressed_original":472940544,"omap_allocated":0,"internal_metadata":375652352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21569536,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2633,"num_write_kb":21064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002083"},"pg_stats":[{"pgid":"5.f","version":"37'1423","reported_seq":1436,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.146671+0000","last_change":"2024-09-22T03:08:05.527169+0000","last_active":"2024-09-22T03:09:11.146671+0000","last_peered":"2024-09-22T03:09:11.146671+0000","last_clean":"2024-09-22T03:09:11.146671+0000","last_became_active":"2024-09-22T03:08:05.504247+0000","last_became_peered":"2024-09-22T03:08:05.504247+0000","last_unstale":"2024-09-22T03:09:11.146671+0000","last_undegraded":"2024-09-22T03:09:11.146671+0000","last_fullsized":"2024-09-22T03:09:11.146671+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11665408,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1424,"num_write_kb":11392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"37'1263","reported_seq":1276,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:10.490532+0000","last_change":"2024-09-22T03:08:05.505551+0000","last_active":"2024-09-22T03:09:10.490532+0000","last_peered":"2024-09-22T03:09:10.490532+0000","last_clean":"2024-09-22T03:09:10.490532+0000","last_became_active":"2024-09-22T03:08:05.502164+0000","last_became_peered":"2024-09-22T03:08:05.502164+0000","last_unstale":"2024-09-22T03:09:10.490532+0000","last_undegraded":"2024-09-22T03:09:10.490532+0000","last_fullsized":"2024-09-22T03:09:10.490532+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1263,"log_dups_size":0,"ondisk_log_size":1263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1264,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"37'1199","reported_seq":1212,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:08.883911+0000","last_change":"2024-09-22T03:08:05.483440+0000","last_active":"2024-09-22T03:09:08.883911+0000","last_peered":"2024-09-22T03:09:08.883911+0000","last_clean":"2024-09-22T03:09:08.883911+0000","last_became_active":"2024-09-22T03:08:05.477343+0000","last_became_peered":"2024-09-22T03:08:05.477343+0000","last_unstale":"2024-09-22T03:09:08.883911+0000","last_undegraded":"2024-09-22T03:09:08.883911+0000","last_fullsized":"2024-09-22T03:09:08.883911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"37'1191","reported_seq":1204,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.349307+0000","last_change":"2024-09-22T03:08:05.485033+0000","last_active":"2024-09-22T03:09:11.349307+0000","last_peered":"2024-09-22T03:09:11.349307+0000","last_clean":"2024-09-22T03:09:11.349307+0000","last_became_active":"2024-09-22T03:08:05.480835+0000","last_became_peered":"2024-09-22T03:08:05.480835+0000","last_unstale":"2024-09-22T03:09:11.349307+0000","last_undegraded":"2024-09-22T03:09:11.349307+0000","last_fullsized":"2024-09-22T03:09:11.349307+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'1096","reported_seq":1109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:10.352055+0000","last_change":"2024-09-22T03:08:05.530920+0000","last_active":"2024-09-22T03:09:10.352055+0000","last_peered":"2024-09-22T03:09:10.352055+0000","last_clean":"2024-09-22T03:09:10.352055+0000","last_became_active":"2024-09-22T03:08:05.527955+0000","last_became_peered":"2024-09-22T03:08:05.527955+0000","last_unstale":"2024-09-22T03:09:10.352055+0000","last_undegraded":"2024-09-22T03:09:10.352055+0000","last_fullsized":"2024-09-22T03:09:10.352055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1096,"log_dups_size":0,"ondisk_log_size":1096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8986624,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":8776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"37'1079","reported_seq":1092,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.679992+0000","last_change":"2024-09-22T03:08:05.534057+0000","last_active":"2024-09-22T03:09:11.679992+0000","last_peered":"2024-09-22T03:09:11.679992+0000","last_clean":"2024-09-22T03:09:11.679992+0000","last_became_active":"2024-09-22T03:08:05.529876+0000","last_became_peered":"2024-09-22T03:08:05.529876+0000","last_unstale":"2024-09-22T03:09:11.679992+0000","last_undegraded":"2024-09-22T03:09:11.679992+0000","last_fullsized":"2024-09-22T03:09:11.679992+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"37'1215","reported_seq":1228,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.612579+0000","last_change":"2024-09-22T03:08:05.523426+0000","last_active":"2024-09-22T03:09:11.612579+0000","last_peered":"2024-09-22T03:09:11.612579+0000","last_clean":"2024-09-22T03:09:11.612579+0000","last_became_active":"2024-09-22T03:08:05.517777+0000","last_became_peered":"2024-09-22T03:08:05.517777+0000","last_unstale":"2024-09-22T03:09:11.612579+0000","last_undegraded":"2024-09-22T03:09:11.612579+0000","last_fullsized":"2024-09-22T03:09:11.612579+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"37'1159","reported_seq":1172,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:10.539484+0000","last_change":"2024-09-22T03:08:05.507606+0000","last_active":"2024-09-22T03:09:10.539484+0000","last_peered":"2024-09-22T03:09:10.539484+0000","last_clean":"2024-09-22T03:09:10.539484+0000","last_became_active":"2024-09-22T03:08:05.500277+0000","last_became_peered":"2024-09-22T03:08:05.500277+0000","last_unstale":"2024-09-22T03:09:10.539484+0000","last_undegraded":"2024-09-22T03:09:10.539484+0000","last_fullsized":"2024-09-22T03:09:10.539484+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":9280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"37'1187","reported_seq":1200,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.726860+0000","last_change":"2024-09-22T03:08:05.498406+0000","last_active":"2024-09-22T03:09:11.726860+0000","last_peered":"2024-09-22T03:09:11.726860+0000","last_clean":"2024-09-22T03:09:11.726860+0000","last_became_active":"2024-09-22T03:08:05.494764+0000","last_became_peered":"2024-09-22T03:08:05.494764+0000","last_unstale":"2024-09-22T03:09:11.726860+0000","last_undegraded":"2024-09-22T03:09:11.726860+0000","last_fullsized":"2024-09-22T03:09:11.726860+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9732096,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":9504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432217+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:08:06.432217+0000","last_peered":"2024-09-22T03:08:06.432217+0000","last_clean":"2024-09-22T03:08:06.432217+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:08:06.432217+0000","last_undegraded":"2024-09-22T03:08:06.432217+0000","last_fullsized":"2024-09-22T03:08:06.432217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"37'1231","reported_seq":1244,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.502211+0000","last_change":"2024-09-22T03:08:05.502489+0000","last_active":"2024-09-22T03:09:11.502211+0000","last_peered":"2024-09-22T03:09:11.502211+0000","last_clean":"2024-09-22T03:09:11.502211+0000","last_became_active":"2024-09-22T03:08:05.493812+0000","last_became_peered":"2024-09-22T03:08:05.493812+0000","last_unstale":"2024-09-22T03:09:11.502211+0000","last_undegraded":"2024-09-22T03:09:11.502211+0000","last_fullsized":"2024-09-22T03:09:11.502211+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1231,"log_dups_size":0,"ondisk_log_size":1231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":9856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432497+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:08:06.432497+0000","last_peered":"2024-09-22T03:08:06.432497+0000","last_clean":"2024-09-22T03:08:06.432497+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:08:06.432497+0000","last_undegraded":"2024-09-22T03:08:06.432497+0000","last_fullsized":"2024-09-22T03:08:06.432497+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'1127","reported_seq":1140,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.633722+0000","last_change":"2024-09-22T03:08:05.492364+0000","last_active":"2024-09-22T03:09:11.633722+0000","last_peered":"2024-09-22T03:09:11.633722+0000","last_clean":"2024-09-22T03:09:11.633722+0000","last_became_active":"2024-09-22T03:08:05.483434+0000","last_became_peered":"2024-09-22T03:08:05.483434+0000","last_unstale":"2024-09-22T03:09:11.633722+0000","last_undegraded":"2024-09-22T03:09:11.633722+0000","last_fullsized":"2024-09-22T03:09:11.633722+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.432168+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:08:06.432168+0000","last_peered":"2024-09-22T03:08:06.432168+0000","last_clean":"2024-09-22T03:08:06.432168+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:08:06.432168+0000","last_undegraded":"2024-09-22T03:08:06.432168+0000","last_fullsized":"2024-09-22T03:08:06.432168+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"37'1175","reported_seq":1188,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:10.066601+0000","last_change":"2024-09-22T03:08:05.510228+0000","last_active":"2024-09-22T03:09:10.066601+0000","last_peered":"2024-09-22T03:09:10.066601+0000","last_clean":"2024-09-22T03:09:10.066601+0000","last_became_active":"2024-09-22T03:08:05.504851+0000","last_became_peered":"2024-09-22T03:08:05.504851+0000","last_unstale":"2024-09-22T03:09:10.066601+0000","last_undegraded":"2024-09-22T03:09:10.066601+0000","last_fullsized":"2024-09-22T03:09:10.066601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.435689+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:08:06.435689+0000","last_peered":"2024-09-22T03:08:06.435689+0000","last_clean":"2024-09-22T03:08:06.435689+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:08:06.435689+0000","last_undegraded":"2024-09-22T03:08:06.435689+0000","last_fullsized":"2024-09-22T03:08:06.435689+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":211,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.443145+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:08:06.443145+0000","last_peered":"2024-09-22T03:08:06.443145+0000","last_clean":"2024-09-22T03:08:06.443145+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:08:06.443145+0000","last_undegraded":"2024-09-22T03:08:06.443145+0000","last_fullsized":"2024-09-22T03:08:06.443145+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"37'1215","reported_seq":1228,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:10.203615+0000","last_change":"2024-09-22T03:08:05.520963+0000","last_active":"2024-09-22T03:09:10.203615+0000","last_peered":"2024-09-22T03:09:10.203615+0000","last_clean":"2024-09-22T03:09:10.203615+0000","last_became_active":"2024-09-22T03:08:05.516106+0000","last_became_peered":"2024-09-22T03:08:05.516106+0000","last_unstale":"2024-09-22T03:09:10.203615+0000","last_undegraded":"2024-09-22T03:09:10.203615+0000","last_fullsized":"2024-09-22T03:09:10.203615+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.433385+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:08:06.433385+0000","last_peered":"2024-09-22T03:08:06.433385+0000","last_clean":"2024-09-22T03:08:06.433385+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:08:06.433385+0000","last_undegraded":"2024-09-22T03:08:06.433385+0000","last_fullsized":"2024-09-22T03:08:06.433385+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'1279","reported_seq":1292,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:10.829565+0000","last_change":"2024-09-22T03:08:05.491561+0000","last_active":"2024-09-22T03:09:10.829565+0000","last_peered":"2024-09-22T03:09:10.829565+0000","last_clean":"2024-09-22T03:09:10.829565+0000","last_became_active":"2024-09-22T03:08:05.486621+0000","last_became_peered":"2024-09-22T03:08:05.486621+0000","last_unstale":"2024-09-22T03:09:10.829565+0000","last_undegraded":"2024-09-22T03:09:10.829565+0000","last_fullsized":"2024-09-22T03:09:10.829565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":160,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1280,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436271+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:08:06.436271+0000","last_peered":"2024-09-22T03:08:06.436271+0000","last_clean":"2024-09-22T03:08:06.436271+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:08:06.436271+0000","last_undegraded":"2024-09-22T03:08:06.436271+0000","last_fullsized":"2024-09-22T03:08:06.436271+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"37'1183","reported_seq":1196,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.793250+0000","last_change":"2024-09-22T03:08:05.491348+0000","last_active":"2024-09-22T03:09:09.793250+0000","last_peered":"2024-09-22T03:09:09.793250+0000","last_clean":"2024-09-22T03:09:09.793250+0000","last_became_active":"2024-09-22T03:08:05.485061+0000","last_became_peered":"2024-09-22T03:08:05.485061+0000","last_unstale":"2024-09-22T03:09:09.793250+0000","last_undegraded":"2024-09-22T03:09:09.793250+0000","last_fullsized":"2024-09-22T03:09:09.793250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1183,"log_dups_size":0,"ondisk_log_size":1183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":9472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.437885+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:08:06.437885+0000","last_peered":"2024-09-22T03:08:06.437885+0000","last_clean":"2024-09-22T03:08:06.437885+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:08:06.437885+0000","last_undegraded":"2024-09-22T03:08:06.437885+0000","last_fullsized":"2024-09-22T03:08:06.437885+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"37'1327","reported_seq":1340,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.716063+0000","last_change":"2024-09-22T03:08:05.501316+0000","last_active":"2024-09-22T03:09:11.716063+0000","last_peered":"2024-09-22T03:09:11.716063+0000","last_clean":"2024-09-22T03:09:11.716063+0000","last_became_active":"2024-09-22T03:08:05.496955+0000","last_became_peered":"2024-09-22T03:08:05.496955+0000","last_unstale":"2024-09-22T03:09:11.716063+0000","last_undegraded":"2024-09-22T03:09:11.716063+0000","last_fullsized":"2024-09-22T03:09:11.716063+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:08:04.397958+0000","last_clean_scrub_stamp":"2024-09-22T03:08:04.397958+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-22T03:08:06.436226+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:08:06.436226+0000","last_peered":"2024-09-22T03:08:06.436226+0000","last_clean":"2024-09-22T03:08:06.436226+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:08:06.436226+0000","last_undegraded":"2024-09-22T03:08:06.436226+0000","last_fullsized":"2024-09-22T03:08:06.436226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":158638080,"num_objects":2422,"num_object_clones":0,"num_object_copies":7266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19365,"num_write_kb":154920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":238256128,"data_stored":476512256,"data_compressed":24601731,"data_compressed_allocated":238256128,"data_compressed_original":476512256,"omap_allocated":0,"internal_metadata":0},"log_size":19349,"ondisk_log_size":19349,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673254,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":160924,"kb_used_data":53580,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94210916,"statfs":{"total":96636764160,"available":96471977984,"internally_reserved":0,"allocated":54865920,"data_stored":109201957,"data_compressed":5632375,"data_compressed_allocated":54546432,"data_compressed_original":109092864,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673254,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":161576,"kb_used_data":68120,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94210264,"statfs":{"total":96636764160,"available":96471310336,"internally_reserved":0,"allocated":69754880,"data_stored":139447365,"data_compressed":7193360,"data_compressed_allocated":69414912,"data_compressed_original":139321344,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673254,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133124,"kb_used_data":47988,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94238716,"statfs":{"total":96636764160,"available":96500445184,"internally_reserved":0,"allocated":49139712,"data_stored":98217029,"data_compressed":5064649,"data_compressed_allocated":48799744,"data_compressed_original":98091008,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142804,"kb_used_data":61824,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94229036,"statfs":{"total":96636764160,"available":96490532864,"internally_reserved":0,"allocated":63307776,"data_stored":126561330,"data_compressed":6527969,"data_compressed_allocated":62971904,"data_compressed_original":126435328,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":63541248,"data_stored":127082496,"data_compressed":6561036,"data_compressed_allocated":63541248,"data_compressed_original":127082496,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49360896,"data_stored":98721792,"data_compressed":5096870,"data_compressed_allocated":49360896,"data_compressed_original":98721792,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":70205440,"data_stored":140410880,"data_compressed":7249269,"data_compressed_allocated":70205440,"data_compressed_original":140410880,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":55148544,"data_stored":110297088,"data_compressed":5694556,"data_compressed_allocated":55148544,"data_compressed_original":110297088,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:16.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 70 16 20692 20676 2.3074 1.99219 0.0973723 0.0541424 2024-09-22T03:09:17.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 71 16 20966 20950 2.30505 2.14062 0.0422907 0.0541991 2024-09-22T03:09:17.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:17.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:17.804+0000 7fa48f6d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:17.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:17.809+0000 7fa48f6d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:18.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 72 16 21209 21193 2.2994 1.89844 0.041814 0.0543168 2024-09-22T03:09:19.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 73 16 21450 21434 2.29369 1.88281 0.0307762 0.0544628 2024-09-22T03:09:19.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:20.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:20.087+0000 7f77b644f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:20.093+0000 7f77b644f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:20.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 74 16 21699 21683 2.28898 1.94531 0.0599635 0.0545838 2024-09-22T03:09:20.798 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:20.798 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:20.799 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:20.799 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:20.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:20.916+0000 7efe7a797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:20.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:20.928+0000 7efe7a797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:20.961 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:20.961 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:20.961 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:21.077+0000 7ff59d82c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:21.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:21.086+0000 7ff59d82c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:21.105 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:21.106 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:21.106 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:21.106 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:21.106 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:21.106 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:21.106 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:21.106 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:21.106 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:21.106 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:21.106 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:21.106 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:21.109 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:21.109 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:21.109 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:21.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:21.217+0000 7faaa0757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:21.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:21.237+0000 7faaa0757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:21.256 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:21.256 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:21.256 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:21.256 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:21.256 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:21.256 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:21.257 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:21.257 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:21.257 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:21.257 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:21.257 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:21.257 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:21.262 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:21.262 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:21.262 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:21.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:21.393+0000 7f9af56fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:21.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:21.404+0000 7f9af56fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:21.453 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:21.456 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:21.456 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:21.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 75 16 21923 21907 2.28179 1.75 0.0290558 0.054753 2024-09-22T03:09:22.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:22.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:22.346+0000 7fa56210e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:22.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:22.352+0000 7fa56210e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:22.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 76 16 22170 22154 2.27716 1.92969 0.022839 0.0548665 2024-09-22T03:09:23.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 77 16 22433 22417 2.27427 2.05469 0.0883177 0.0549419 2024-09-22T03:09:24.462 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:24.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 78 16 22678 22662 2.26965 1.91406 0.0559047 0.0550482 2024-09-22T03:09:24.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:24.592+0000 7f495fe2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:24.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:24.601+0000 7f495fe2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:25.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 79 16 22912 22896 2.26406 1.82812 0.0513276 0.0551844 2024-09-22T03:09:26.457 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:26.457 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:26.457 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:26.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:26.508 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:09:26.508123+0000 min lat: 0.00824185 max lat: 0.182854 avg lat: 0.0552931 2024-09-22T03:09:26.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:09:26.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 80 16 23153 23137 2.25929 1.88281 0.0379888 0.0552931 2024-09-22T03:09:26.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:26.579+0000 7fe19fcce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:26.590+0000 7fe19fcce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:26.686 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:26.686 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:26.686 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:26.686 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:26.686 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:26.686 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:26.686 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:26.686 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:26.686 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:26.686 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:26.687 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:26.687 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:26.690 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:26.690 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:26.690 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:26.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:26.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:26.824+0000 7f3d46a23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:26.842+0000 7f3d46a23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:26.866 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:26.869 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:26.869 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:26.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:26.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:26.909+0000 7fb54242c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:26.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:26.918+0000 7fb54242c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:27.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:26.998+0000 7f0e1a717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:27.008+0000 7f0e1a717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:27.031 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:27.031 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:27.031 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:27.172+0000 7fc38bf57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:27.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:27.183+0000 7fc38bf57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:27.228 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:27.229 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:27.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 81 16 23404 23388 2.2556 1.96094 0.0518522 0.0553913 2024-09-22T03:09:28.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 82 16 23642 23626 2.25077 1.85938 0.0369881 0.0555045 2024-09-22T03:09:29.035 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:29.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:29.179+0000 7fb68fa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:29.186+0000 7fb68fa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:29.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 83 16 23885 23869 2.24652 1.89844 0.0744942 0.0556204 2024-09-22T03:09:30.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 84 16 24128 24112 2.24238 1.89844 0.0792418 0.0557015 2024-09-22T03:09:31.363 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:31.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:31.485+0000 7f22f706c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:31.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:31.491+0000 7f22f706c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:31.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 85 16 24363 24347 2.23759 1.83594 0.0385384 0.055836 2024-09-22T03:09:32.229 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:32.229 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:32.229 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:32.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:32.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:32.342+0000 7f5dd7797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:32.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:32.353+0000 7f5dd7797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:32.370 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:32.370 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:32.371 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:32.371 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:32.371 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:32.371 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:32.371 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:32.371 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:32.371 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:32.371 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:32.371 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:32.371 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:32.375 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:32.375 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:32.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:32.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:32.496+0000 7f2f6ce2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:32.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:32.507+0000 7f2f6ce2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:32.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 86 16 24587 24571 2.23192 1.75 0.0834058 0.0559816 2024-09-22T03:09:32.526 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:32.526 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:32.526 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:32.526 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:32.526 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:32.526 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:32.527 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:32.527 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:32.527 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:32.527 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:32.527 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:32.527 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:32.529 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:32.530 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:32.530 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:32.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:32.650+0000 7ff6386d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:32.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:32.662+0000 7ff6386d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:32.687 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:32.687 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:32.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:32.815+0000 7f7eec6a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:32.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:32.825+0000 7f7eec6a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:32.845 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:32.845 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:32.845 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:32.845 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:32.845 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:32.846 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:32.846 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:32.846 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:32.846 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:32.846 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:32.846 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:32.846 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:32.850 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:32.850 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:33.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 87 16 24827 24811 2.22782 1.875 0.0416264 0.05607 2024-09-22T03:09:33.600 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:33.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:33.721+0000 7f1da5b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:33.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:33.727+0000 7f1da5b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:34.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 88 16 25070 25054 2.22407 1.89844 0.0408384 0.0561777 2024-09-22T03:09:35.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 89 16 25295 25279 2.21883 1.75781 0.0816735 0.056307 2024-09-22T03:09:35.927 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:36.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:36.047+0000 7f4c2c117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:36.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:36.052+0000 7f4c2c117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:36.509 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 90 16 25525 25509 2.21414 1.79688 0.0282282 0.0564244 2024-09-22T03:09:37.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total time run: 90.0611 2024-09-22T03:09:37.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total writes made: 25525 2024-09-22T03:09:37.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Write size: 8192 2024-09-22T03:09:37.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object size: 65536 2024-09-22T03:09:37.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Bandwidth (MB/sec): 2.21421 2024-09-22T03:09:37.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Bandwidth: 0.313495 2024-09-22T03:09:37.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max bandwidth (MB/sec): 2.84375 2024-09-22T03:09:37.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min bandwidth (MB/sec): 1.75 2024-09-22T03:09:37.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average IOPS: 283 2024-09-22T03:09:37.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev IOPS: 40.1273 2024-09-22T03:09:37.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max IOPS: 364 2024-09-22T03:09:37.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min IOPS: 224 2024-09-22T03:09:37.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average Latency(s): 0.0564361 2024-09-22T03:09:37.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Latency(s): 0.0248258 2024-09-22T03:09:37.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max latency(s): 0.182854 2024-09-22T03:09:37.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min latency(s): 0.00824185 2024-09-22T03:09:37.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:09:37.851 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:37.851 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:37.851 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:37.851 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:37.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:37.979+0000 7f4672218640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:37.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:37.993+0000 7f4672218640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:38.047 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:38.047 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:38.051 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:38.051 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:38.051 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:38.183 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:38.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:38.192+0000 7fd408197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:38.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:38.210+0000 7fd406f35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:38.231 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:38.231 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:38.231 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:38.231 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:38.231 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:38.231 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:38.231 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:38.231 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:38.231 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:38.231 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:38.231 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:38.232 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:38.237 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:38.238 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:38.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:38.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:38.328+0000 7f278f597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:38.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:38.339+0000 7f278f597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:38.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:38.417+0000 7fb673717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:38.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:38.432+0000 7fb673717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:38.465 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:38.465 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:38.465 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:38.465 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:38.465 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:38.465 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:38.465 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:38.465 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:38.466 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:38.466 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:38.466 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:38.466 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:38.469 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:38.469 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:38.469 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:38.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:38.623+0000 7f6595e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:38.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:38.635+0000 7f6595e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:38.657 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:38.657 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:38.657 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:38.657 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:38.657 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:38.657 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:38.657 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:38.657 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:38.657 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:38.657 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:38.658 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:38.658 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:38.661 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:38.661 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:40.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:40.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:40.673+0000 7f7faab0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:40.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:40.682+0000 7f7faab0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:42.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:42.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:42.994+0000 7f66fee6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:43.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:43.004+0000 7f66fee6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:43.662 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:43.662 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:43.662 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:43.662 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:43.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:43.782+0000 7fa144ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:43.792+0000 7fa144ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:43.897 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:43.897 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:43.897 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:43.897 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:43.897 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:43.897 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:43.897 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:43.897 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:43.897 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:43.898 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:43.898 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:43.898 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:43.900 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:43.901 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:43.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:44.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:44.017+0000 7fd856e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:44.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:44.026+0000 7fd856e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:44.053 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:44.053 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:44.054 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:44.186+0000 7fc6b004f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:44.197+0000 7fc6b004f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:44.215 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:44.219 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:44.219 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:44.219 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:44.359+0000 7fd0c8c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:44.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:44.369+0000 7fd0c8c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:44.387 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:44.387 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:44.387 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:44.387 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:44.387 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:44.387 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:44.387 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:44.387 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:44.388 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:44.388 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:44.388 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:44.388 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:44.391 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:44.391 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:45.260 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:45.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:45.401+0000 7efe53f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:45.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:45.408+0000 7efe53f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:47.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:47.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:47.781+0000 7f7402117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:47.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:47.790+0000 7f7402117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:48.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Removed 3191 objects 2024-09-22T03:09:48.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Clean up completed and total clean up time :11.0459 2024-09-22T03:09:49.392 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:49.392 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:09:49.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:49.495+0000 7fd4e7117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:49.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:49.505+0000 7fd4e7117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:49.998 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:50.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:50.097+0000 7fbf3fa2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:50.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:50.101+0000 7fbf3fa2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:50.162 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2024-09-22T03:09:50.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-09-22T03:09:50.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:50.259+0000 7f084f997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:50.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:50.270+0000 7f084f997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:50.426 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:09:50.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:09:50.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:50.540+0000 7fcd9a357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:50.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:50.548+0000 7fcd9a357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:51.433 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_2' removed 2024-09-22T03:09:51.433 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:09:51.450 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:09:51.450 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:09:51.451 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2024-09-22T03:09:51.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 16 2024-09-22T03:09:51.452 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:09:51.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:51.610+0000 7f05eb397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:51.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:51.622+0000 7f05eb397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:51.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:51.626+0000 7f046266c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:51.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:51.645+0000 7f046266c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:52.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:52.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:52.275+0000 7fa636397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:52.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:52.279+0000 7fa636397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:52.434 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:09:52.434 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_3' created 2024-09-22T03:09:52.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:09:52.452 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-09-22T03:09:52.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:52.565+0000 7f7ebb418640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:52.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:52.573+0000 7f7ebb418640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:52.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:52.569+0000 7f554eb57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:52.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:52.583+0000 7f554eb57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:53.441 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:09:53.441 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-09-22T03:09:53.468 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:09:53.468 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:53.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:53.632+0000 7f31edd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:53.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:53.638+0000 7f31edd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:53.815 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:09:53.816 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:09:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-22T03:09:53.441113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":434984,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":433472,"kb_avail":377052376,"statfs":{"total":386547056640,"available":386101633024,"internally_reserved":0,"allocated":1482752,"data_stored":2217276,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":443875328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-42639384,"num_objects":-652,"num_object_clones":0,"num_object_copies":-1956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-28066,"num_write_kb":-204201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.692146"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.451904+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:09:51.451904+0000","last_peered":"2024-09-22T03:09:51.451904+0000","last_clean":"2024-09-22T03:09:51.451904+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:09:51.451904+0000","last_undegraded":"2024-09-22T03:09:51.451904+0000","last_fullsized":"2024-09-22T03:09:51.451904+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:09:50.448726+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:09:50.448726+0000","last_peered":"2024-09-22T03:09:50.448726+0000","last_clean":"2024-09-22T03:09:50.448726+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:09:50.448726+0000","last_undegraded":"2024-09-22T03:09:50.448726+0000","last_fullsized":"2024-09-22T03:09:50.448726+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.445475+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:09:51.445475+0000","last_peered":"2024-09-22T03:09:51.445475+0000","last_clean":"2024-09-22T03:09:51.445475+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:09:51.445475+0000","last_undegraded":"2024-09-22T03:09:51.445475+0000","last_fullsized":"2024-09-22T03:09:51.445475+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.469595+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:09:51.469595+0000","last_peered":"2024-09-22T03:09:51.469595+0000","last_clean":"2024-09-22T03:09:51.469595+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:09:51.469595+0000","last_undegraded":"2024-09-22T03:09:51.469595+0000","last_fullsized":"2024-09-22T03:09:51.469595+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":214,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:09:50.453123+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:09:50.453123+0000","last_peered":"2024-09-22T03:09:50.453123+0000","last_clean":"2024-09-22T03:09:50.453123+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:09:50.453123+0000","last_undegraded":"2024-09-22T03:09:50.453123+0000","last_fullsized":"2024-09-22T03:09:50.453123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.440250+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:09:51.440250+0000","last_peered":"2024-09-22T03:09:51.440250+0000","last_clean":"2024-09-22T03:09:51.440250+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:09:51.440250+0000","last_undegraded":"2024-09-22T03:09:51.440250+0000","last_fullsized":"2024-09-22T03:09:51.440250+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.473848+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:09:51.473848+0000","last_peered":"2024-09-22T03:09:51.473848+0000","last_clean":"2024-09-22T03:09:51.473848+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:09:51.473848+0000","last_undegraded":"2024-09-22T03:09:51.473848+0000","last_fullsized":"2024-09-22T03:09:51.473848+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.451969+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:09:51.451969+0000","last_peered":"2024-09-22T03:09:51.451969+0000","last_clean":"2024-09-22T03:09:51.451969+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:09:51.451969+0000","last_undegraded":"2024-09-22T03:09:51.451969+0000","last_fullsized":"2024-09-22T03:09:51.451969+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.455341+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:09:51.455341+0000","last_peered":"2024-09-22T03:09:51.455341+0000","last_clean":"2024-09-22T03:09:51.455341+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:09:51.455341+0000","last_undegraded":"2024-09-22T03:09:51.455341+0000","last_fullsized":"2024-09-22T03:09:51.455341+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99344,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272496,"statfs":{"total":96636764160,"available":96535035904,"internally_reserved":0,"allocated":327680,"data_stored":112366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111884,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259956,"statfs":{"total":96636764160,"available":96522194944,"internally_reserved":0,"allocated":389120,"data_stored":702734,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111884,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259956,"statfs":{"total":96636764160,"available":96522194944,"internally_reserved":0,"allocated":389120,"data_stored":702734,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111872,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259968,"statfs":{"total":96636764160,"available":96522207232,"internally_reserved":0,"allocated":376832,"data_stored":699442,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:53.829 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:53.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:53.928+0000 7f03def97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:53.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:53.935+0000 7f03def97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:54.112 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:09:54.113 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:09:54.125 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-22T03:09:53.441113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":434984,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":433472,"kb_avail":377052376,"statfs":{"total":386547056640,"available":386101633024,"internally_reserved":0,"allocated":1482752,"data_stored":2217276,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":443875328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-42639384,"num_objects":-652,"num_object_clones":0,"num_object_copies":-1956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-28066,"num_write_kb":-204201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.692146"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.451904+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:09:51.451904+0000","last_peered":"2024-09-22T03:09:51.451904+0000","last_clean":"2024-09-22T03:09:51.451904+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:09:51.451904+0000","last_undegraded":"2024-09-22T03:09:51.451904+0000","last_fullsized":"2024-09-22T03:09:51.451904+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:09:50.448726+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:09:50.448726+0000","last_peered":"2024-09-22T03:09:50.448726+0000","last_clean":"2024-09-22T03:09:50.448726+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:09:50.448726+0000","last_undegraded":"2024-09-22T03:09:50.448726+0000","last_fullsized":"2024-09-22T03:09:50.448726+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.445475+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:09:51.445475+0000","last_peered":"2024-09-22T03:09:51.445475+0000","last_clean":"2024-09-22T03:09:51.445475+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:09:51.445475+0000","last_undegraded":"2024-09-22T03:09:51.445475+0000","last_fullsized":"2024-09-22T03:09:51.445475+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.469595+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:09:51.469595+0000","last_peered":"2024-09-22T03:09:51.469595+0000","last_clean":"2024-09-22T03:09:51.469595+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:09:51.469595+0000","last_undegraded":"2024-09-22T03:09:51.469595+0000","last_fullsized":"2024-09-22T03:09:51.469595+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":214,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:09:50.453123+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:09:50.453123+0000","last_peered":"2024-09-22T03:09:50.453123+0000","last_clean":"2024-09-22T03:09:50.453123+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:09:50.453123+0000","last_undegraded":"2024-09-22T03:09:50.453123+0000","last_fullsized":"2024-09-22T03:09:50.453123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.440250+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:09:51.440250+0000","last_peered":"2024-09-22T03:09:51.440250+0000","last_clean":"2024-09-22T03:09:51.440250+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:09:51.440250+0000","last_undegraded":"2024-09-22T03:09:51.440250+0000","last_fullsized":"2024-09-22T03:09:51.440250+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.473848+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:09:51.473848+0000","last_peered":"2024-09-22T03:09:51.473848+0000","last_clean":"2024-09-22T03:09:51.473848+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:09:51.473848+0000","last_undegraded":"2024-09-22T03:09:51.473848+0000","last_fullsized":"2024-09-22T03:09:51.473848+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.451969+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:09:51.451969+0000","last_peered":"2024-09-22T03:09:51.451969+0000","last_clean":"2024-09-22T03:09:51.451969+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:09:51.451969+0000","last_undegraded":"2024-09-22T03:09:51.451969+0000","last_fullsized":"2024-09-22T03:09:51.451969+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.455341+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:09:51.455341+0000","last_peered":"2024-09-22T03:09:51.455341+0000","last_clean":"2024-09-22T03:09:51.455341+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:09:51.455341+0000","last_undegraded":"2024-09-22T03:09:51.455341+0000","last_fullsized":"2024-09-22T03:09:51.455341+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99344,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272496,"statfs":{"total":96636764160,"available":96535035904,"internally_reserved":0,"allocated":327680,"data_stored":112366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111884,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259956,"statfs":{"total":96636764160,"available":96522194944,"internally_reserved":0,"allocated":389120,"data_stored":702734,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111884,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259956,"statfs":{"total":96636764160,"available":96522194944,"internally_reserved":0,"allocated":389120,"data_stored":702734,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111872,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259968,"statfs":{"total":96636764160,"available":96522207232,"internally_reserved":0,"allocated":376832,"data_stored":699442,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:54.127 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-22T03:09:54.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:54.227+0000 7f4be2463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:54.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:54.232+0000 7f4be2463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:54.350 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:54.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:54.459+0000 7fed1cb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:54.464 DEBUG:teuthology.orchestra.run.smithi134:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-09-22T03:09:54.466 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:09:54.466 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:09:54.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:54.464+0000 7fed1cb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:54.491 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:09:54.491 INFO:teuthology.orchestra.run.smithi134.stdout:{"fsid":"3c083707-cce1-453e-8e70-29f18e875f9d","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"1 pool(s) do not have an application enabled","count":1},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":346,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":42,"num_osds":4,"num_up_osds":4,"osd_up_since":1726974256,"num_in_osds":4,"osd_in_since":1726974250,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":445423616,"bytes_avail":386101633024,"bytes_total":386547056640,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-22T03:04:08:383251+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-22T03:05:14.700015+0000","services":{}},"progress_events":{}} 2024-09-22T03:09:54.506 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-22T03:09:54.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:54.525 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:hints = 1 2024-09-22T03:09:54.525 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:09:54.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object prefix: benchmark_data_smithi134_43504 2024-09-22T03:09:54.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:09:54.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:09:54.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:54.651+0000 7fdcedf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:54.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:54.660+0000 7fdcedf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:09:54.873 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:09:54.889 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-22T03:09:54.750106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":434984,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":433472,"kb_avail":377052376,"statfs":{"total":386547056640,"available":386101633024,"internally_reserved":0,"allocated":1482752,"data_stored":2217276,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":443875328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19439616,"num_objects":-297,"num_object_clones":0,"num_object_copies":-891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-28421,"num_write_kb":-204201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000694"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.451904+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:09:51.451904+0000","last_peered":"2024-09-22T03:09:51.451904+0000","last_clean":"2024-09-22T03:09:51.451904+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:09:51.451904+0000","last_undegraded":"2024-09-22T03:09:51.451904+0000","last_fullsized":"2024-09-22T03:09:51.451904+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:09:50.448726+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:09:50.448726+0000","last_peered":"2024-09-22T03:09:50.448726+0000","last_clean":"2024-09-22T03:09:50.448726+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:09:50.448726+0000","last_undegraded":"2024-09-22T03:09:50.448726+0000","last_fullsized":"2024-09-22T03:09:50.448726+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.445475+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:09:51.445475+0000","last_peered":"2024-09-22T03:09:51.445475+0000","last_clean":"2024-09-22T03:09:51.445475+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:09:51.445475+0000","last_undegraded":"2024-09-22T03:09:51.445475+0000","last_fullsized":"2024-09-22T03:09:51.445475+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.469595+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:09:51.469595+0000","last_peered":"2024-09-22T03:09:51.469595+0000","last_clean":"2024-09-22T03:09:51.469595+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:09:51.469595+0000","last_undegraded":"2024-09-22T03:09:51.469595+0000","last_fullsized":"2024-09-22T03:09:51.469595+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":214,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:09:50.453123+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:09:50.453123+0000","last_peered":"2024-09-22T03:09:50.453123+0000","last_clean":"2024-09-22T03:09:50.453123+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:09:50.453123+0000","last_undegraded":"2024-09-22T03:09:50.453123+0000","last_fullsized":"2024-09-22T03:09:50.453123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.440250+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:09:51.440250+0000","last_peered":"2024-09-22T03:09:51.440250+0000","last_clean":"2024-09-22T03:09:51.440250+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:09:51.440250+0000","last_undegraded":"2024-09-22T03:09:51.440250+0000","last_fullsized":"2024-09-22T03:09:51.440250+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.473848+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:09:51.473848+0000","last_peered":"2024-09-22T03:09:51.473848+0000","last_clean":"2024-09-22T03:09:51.473848+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:09:51.473848+0000","last_undegraded":"2024-09-22T03:09:51.473848+0000","last_fullsized":"2024-09-22T03:09:51.473848+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.451969+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:09:51.451969+0000","last_peered":"2024-09-22T03:09:51.451969+0000","last_clean":"2024-09-22T03:09:51.451969+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:09:51.451969+0000","last_undegraded":"2024-09-22T03:09:51.451969+0000","last_fullsized":"2024-09-22T03:09:51.451969+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:09:52.432030+0000","last_change":"2024-09-22T03:09:52.432030+0000","last_active":"2024-09-22T03:09:52.432030+0000","last_peered":"2024-09-22T03:09:52.432030+0000","last_clean":"2024-09-22T03:09:52.432030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:09:52.432030+0000","last_undegraded":"2024-09-22T03:09:52.432030+0000","last_fullsized":"2024-09-22T03:09:52.432030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:09:51.455341+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:09:51.455341+0000","last_peered":"2024-09-22T03:09:51.455341+0000","last_clean":"2024-09-22T03:09:51.455341+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:09:51.455341+0000","last_undegraded":"2024-09-22T03:09:51.455341+0000","last_fullsized":"2024-09-22T03:09:51.455341+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99344,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272496,"statfs":{"total":96636764160,"available":96535035904,"internally_reserved":0,"allocated":327680,"data_stored":112366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111884,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259956,"statfs":{"total":96636764160,"available":96522194944,"internally_reserved":0,"allocated":389120,"data_stored":702734,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111884,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259956,"statfs":{"total":96636764160,"available":96522194944,"internally_reserved":0,"allocated":389120,"data_stored":702734,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111872,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259968,"statfs":{"total":96636764160,"available":96522207232,"internally_reserved":0,"allocated":376832,"data_stored":699442,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:55.525 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 1 16 333 317 2.47642 2.47656 0.017105 0.0493299 2024-09-22T03:09:56.525 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 2 16 695 679 2.65216 2.82812 0.0491515 0.0464368 2024-09-22T03:09:56.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:56.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:56.692+0000 7fc0090ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:56.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:56.698+0000 7fc0090ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:57.525 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 3 16 1058 1042 2.71337 2.83594 0.0297897 0.0456085 2024-09-22T03:09:57.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:58.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:58.057+0000 7f330af0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:58.067+0000 7f330af0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.310 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:09:58.310 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:09:58.324 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-22T03:09:56.750408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6382131,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":846,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":448228,"kb_used_data":6372,"kb_used_omap":0,"kb_used_meta":441792,"kb_avail":377039132,"statfs":{"total":386547056640,"available":386088071168,"internally_reserved":0,"allocated":6524928,"data_stored":12050129,"data_compressed":592996,"data_compressed_allocated":5009408,"data_compressed_original":11493376,"omap_allocated":0,"internal_metadata":452395008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5791744,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":5656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.317721"},"pg_stats":[{"pgid":"6.f","version":"42'63","reported_seq":76,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.451592+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:09:56.451592+0000","last_peered":"2024-09-22T03:09:56.451592+0000","last_clean":"2024-09-22T03:09:56.451592+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:09:56.451592+0000","last_undegraded":"2024-09-22T03:09:56.451592+0000","last_fullsized":"2024-09-22T03:09:56.451592+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"42'64","reported_seq":77,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.515880+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:09:56.515880+0000","last_peered":"2024-09-22T03:09:56.515880+0000","last_clean":"2024-09-22T03:09:56.515880+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:09:56.515880+0000","last_undegraded":"2024-09-22T03:09:56.515880+0000","last_fullsized":"2024-09-22T03:09:56.515880+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532480,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"42'71","reported_seq":84,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.729917+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:09:56.729917+0000","last_peered":"2024-09-22T03:09:56.729917+0000","last_clean":"2024-09-22T03:09:56.729917+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:09:56.729917+0000","last_undegraded":"2024-09-22T03:09:56.729917+0000","last_fullsized":"2024-09-22T03:09:56.729917+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"42'24","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.458898+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:09:56.458898+0000","last_peered":"2024-09-22T03:09:56.458898+0000","last_clean":"2024-09-22T03:09:56.458898+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:09:56.458898+0000","last_undegraded":"2024-09-22T03:09:56.458898+0000","last_fullsized":"2024-09-22T03:09:56.458898+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204800,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'31","reported_seq":44,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.520359+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:09:56.520359+0000","last_peered":"2024-09-22T03:09:56.520359+0000","last_clean":"2024-09-22T03:09:56.520359+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:09:56.520359+0000","last_undegraded":"2024-09-22T03:09:56.520359+0000","last_fullsized":"2024-09-22T03:09:56.520359+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"42'31","reported_seq":44,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.013488+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:09:56.013488+0000","last_peered":"2024-09-22T03:09:56.013488+0000","last_clean":"2024-09-22T03:09:56.013488+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:09:56.013488+0000","last_undegraded":"2024-09-22T03:09:56.013488+0000","last_fullsized":"2024-09-22T03:09:56.013488+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"42'31","reported_seq":44,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.039139+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:09:56.039139+0000","last_peered":"2024-09-22T03:09:56.039139+0000","last_clean":"2024-09-22T03:09:56.039139+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:09:56.039139+0000","last_undegraded":"2024-09-22T03:09:56.039139+0000","last_fullsized":"2024-09-22T03:09:56.039139+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"42'32","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:55.461693+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:09:55.461693+0000","last_peered":"2024-09-22T03:09:55.461693+0000","last_clean":"2024-09-22T03:09:55.461693+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:09:55.461693+0000","last_undegraded":"2024-09-22T03:09:55.461693+0000","last_fullsized":"2024-09-22T03:09:55.461693+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270336,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'7","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:55.414658+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:09:55.414658+0000","last_peered":"2024-09-22T03:09:55.414658+0000","last_clean":"2024-09-22T03:09:55.414658+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:09:55.414658+0000","last_undegraded":"2024-09-22T03:09:55.414658+0000","last_fullsized":"2024-09-22T03:09:55.414658+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.448786+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:09:54.448786+0000","last_peered":"2024-09-22T03:09:54.448786+0000","last_clean":"2024-09-22T03:09:54.448786+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:09:54.448786+0000","last_undegraded":"2024-09-22T03:09:54.448786+0000","last_fullsized":"2024-09-22T03:09:54.448786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"42'23","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.681726+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:09:56.681726+0000","last_peered":"2024-09-22T03:09:56.681726+0000","last_clean":"2024-09-22T03:09:56.681726+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:09:56.681726+0000","last_undegraded":"2024-09-22T03:09:56.681726+0000","last_fullsized":"2024-09-22T03:09:56.681726+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.450212+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:09:54.450212+0000","last_peered":"2024-09-22T03:09:54.450212+0000","last_clean":"2024-09-22T03:09:54.450212+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:09:54.450212+0000","last_undegraded":"2024-09-22T03:09:54.450212+0000","last_fullsized":"2024-09-22T03:09:54.450212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"42'71","reported_seq":84,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.657847+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:09:56.657847+0000","last_peered":"2024-09-22T03:09:56.657847+0000","last_clean":"2024-09-22T03:09:56.657847+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:09:56.657847+0000","last_undegraded":"2024-09-22T03:09:56.657847+0000","last_fullsized":"2024-09-22T03:09:56.657847+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":102,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.451320+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:09:54.451320+0000","last_peered":"2024-09-22T03:09:54.451320+0000","last_clean":"2024-09-22T03:09:54.451320+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:09:54.451320+0000","last_undegraded":"2024-09-22T03:09:54.451320+0000","last_fullsized":"2024-09-22T03:09:54.451320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"42'47","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.554731+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:09:56.554731+0000","last_peered":"2024-09-22T03:09:56.554731+0000","last_clean":"2024-09-22T03:09:56.554731+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:09:56.554731+0000","last_undegraded":"2024-09-22T03:09:56.554731+0000","last_fullsized":"2024-09-22T03:09:56.554731+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":101,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453949+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:09:54.453949+0000","last_peered":"2024-09-22T03:09:54.453949+0000","last_clean":"2024-09-22T03:09:54.453949+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:09:54.453949+0000","last_undegraded":"2024-09-22T03:09:54.453949+0000","last_fullsized":"2024-09-22T03:09:54.453949+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":226,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453177+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:09:54.453177+0000","last_peered":"2024-09-22T03:09:54.453177+0000","last_clean":"2024-09-22T03:09:54.453177+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:09:54.453177+0000","last_undegraded":"2024-09-22T03:09:54.453177+0000","last_fullsized":"2024-09-22T03:09:54.453177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"42'15","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:55.536575+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:09:55.536575+0000","last_peered":"2024-09-22T03:09:55.536575+0000","last_clean":"2024-09-22T03:09:55.536575+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:09:55.536575+0000","last_undegraded":"2024-09-22T03:09:55.536575+0000","last_fullsized":"2024-09-22T03:09:55.536575+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.454268+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:09:54.454268+0000","last_peered":"2024-09-22T03:09:54.454268+0000","last_clean":"2024-09-22T03:09:54.454268+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:09:54.454268+0000","last_undegraded":"2024-09-22T03:09:54.454268+0000","last_fullsized":"2024-09-22T03:09:54.454268+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"42'47","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.557470+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:09:56.557470+0000","last_peered":"2024-09-22T03:09:56.557470+0000","last_clean":"2024-09-22T03:09:56.557470+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:09:56.557470+0000","last_undegraded":"2024-09-22T03:09:56.557470+0000","last_fullsized":"2024-09-22T03:09:56.557470+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.456175+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:09:54.456175+0000","last_peered":"2024-09-22T03:09:54.456175+0000","last_clean":"2024-09-22T03:09:54.456175+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:09:54.456175+0000","last_undegraded":"2024-09-22T03:09:54.456175+0000","last_fullsized":"2024-09-22T03:09:54.456175+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"42'71","reported_seq":84,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.608762+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:09:56.608762+0000","last_peered":"2024-09-22T03:09:56.608762+0000","last_clean":"2024-09-22T03:09:56.608762+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:09:56.608762+0000","last_undegraded":"2024-09-22T03:09:56.608762+0000","last_fullsized":"2024-09-22T03:09:56.608762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.459126+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:09:54.459126+0000","last_peered":"2024-09-22T03:09:54.459126+0000","last_clean":"2024-09-22T03:09:54.459126+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:09:54.459126+0000","last_undegraded":"2024-09-22T03:09:54.459126+0000","last_fullsized":"2024-09-22T03:09:54.459126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"42'63","reported_seq":76,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:56.426433+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:09:56.426433+0000","last_peered":"2024-09-22T03:09:56.426433+0000","last_clean":"2024-09-22T03:09:56.426433+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:09:56.426433+0000","last_undegraded":"2024-09-22T03:09:56.426433+0000","last_fullsized":"2024-09-22T03:09:56.426433+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.457345+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:09:54.457345+0000","last_peered":"2024-09-22T03:09:54.457345+0000","last_clean":"2024-09-22T03:09:54.457345+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:09:54.457345+0000","last_undegraded":"2024-09-22T03:09:54.457345+0000","last_fullsized":"2024-09-22T03:09:54.457345+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":5791744,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":5656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8089600,"data_stored":16179200,"data_compressed":833120,"data_compressed_allocated":8089600,"data_compressed_original":16179200,"omap_allocated":0,"internal_metadata":0},"log_size":691,"ondisk_log_size":691,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673299,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104752,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267088,"statfs":{"total":96636764160,"available":96529498112,"internally_reserved":0,"allocated":1605632,"data_stored":2608673,"data_compressed":127786,"data_compressed_allocated":1241088,"data_compressed_original":2482176,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673299,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113488,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94258352,"statfs":{"total":96636764160,"available":96520552448,"internally_reserved":0,"allocated":2031616,"data_stored":3928129,"data_compressed":195290,"data_compressed_allocated":1646592,"data_compressed_original":3784704,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673299,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113372,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94258468,"statfs":{"total":96636764160,"available":96520671232,"internally_reserved":0,"allocated":1912832,"data_stored":3690561,"data_compressed":183068,"data_compressed_allocated":1527808,"data_compressed_original":3547136,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116616,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94255224,"statfs":{"total":96636764160,"available":96517349376,"internally_reserved":0,"allocated":974848,"data_stored":1822766,"data_compressed":86852,"data_compressed_allocated":593920,"data_compressed_original":1679360,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1486848,"data_stored":2973696,"data_compressed":153108,"data_compressed_allocated":1486848,"data_compressed_original":2973696,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2301952,"data_stored":4603904,"data_compressed":237086,"data_compressed_allocated":2301952,"data_compressed_original":4603904,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2326528,"data_stored":4653056,"data_compressed":239602,"data_compressed_allocated":2326528,"data_compressed_original":4653056,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1974272,"data_stored":3948544,"data_compressed":203324,"data_compressed_allocated":1974272,"data_compressed_original":3948544,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:58.325 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:09:58.325 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:58.325 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:58.326 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:58.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:58.441+0000 7f7249917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:58.454+0000 7f7249917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.490 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:58.490 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:58.490 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:58.490 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:58.490 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:58.490 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:58.491 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:58.491 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:58.491 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:58.491 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:58.491 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:58.491 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:58.493 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:58.494 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:58.494 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:58.525 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 4 16 1392 1376 2.68733 2.60938 0.116101 0.0464151 2024-09-22T03:09:58.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:58.630+0000 7f9741058640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:58.642+0000 7f9741058640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.714 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:58.714 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:58.714 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:58.714 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:58.714 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:58.714 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:58.715 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:58.715 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:58.715 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:58.715 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:58.715 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:58.715 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:58.718 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:58.719 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:58.719 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:58.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:58.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:58.883+0000 7fa3f4d4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:58.896+0000 7fa3f4d4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.919 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:58.981 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:58.981 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:58.981 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:58.981 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:58.981 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:58.981 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:58.981 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:58.981 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:58.981 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:58.981 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:58.981 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:58.982 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:58.983 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:58.983 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:58.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:58.988+0000 7f09f9a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:58.995+0000 7f09f9a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:59.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:59.146+0000 7fe43bd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:59.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:09:59.159+0000 7fe43bd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:59.226 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:59.226 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:09:59.226 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:09:59.226 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:09:59.226 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:09:59.226 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:09:59.226 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:09:59.226 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:09:59.226 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:09:59.227 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:09:59.227 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:09:59.227 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:09:59.230 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:59.230 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:59.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 5 16 1734 1718 2.68419 2.67188 0.0137922 0.0462711 2024-09-22T03:10:00.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 6 16 2117 2101 2.73549 2.99219 0.0700017 0.0455217 2024-09-22T03:10:01.127 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:01.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:01.267+0000 7f4adeb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:01.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:01.273+0000 7f4adeb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:01.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 7 16 2451 2435 2.71745 2.60938 0.0389905 0.0457796 2024-09-22T03:10:02.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 8 16 2830 2814 2.74786 2.96094 0.0325022 0.0453818 2024-09-22T03:10:03.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:03.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 9 16 3216 3200 2.77758 3.01562 0.0313869 0.0448853 2024-09-22T03:10:03.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:03.604+0000 7fe00d997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:03.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:03.609+0000 7fe00d997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:04.231 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:10:04.231 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:10:04.231 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:04.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:04.378+0000 7fa8d4b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:04.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:04.390+0000 7fa8d4b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:04.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 10 16 3563 3547 2.7709 2.71094 0.0582422 0.044959 2024-09-22T03:10:04.597 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:10:04.597 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:10:04.612 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-09-22T03:10:02.751368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20980275,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2628,"num_write_kb":21808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2573,"ondisk_log_size":2573,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":440672,"kb_used_data":27936,"kb_used_omap":0,"kb_used_meta":412672,"kb_avail":377046688,"statfs":{"total":386547056640,"available":386095808512,"internally_reserved":0,"allocated":28606464,"data_stored":56213201,"data_compressed":2871582,"data_compressed_allocated":27090944,"data_compressed_original":55656448,"omap_allocated":0,"internal_metadata":422576128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20389888,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2489,"num_write_kb":19912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.310255"},"pg_stats":[{"pgid":"6.f","version":"42'159","reported_seq":172,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.686396+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:10:01.686396+0000","last_peered":"2024-09-22T03:10:01.686396+0000","last_clean":"2024-09-22T03:10:01.686396+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:10:01.686396+0000","last_undegraded":"2024-09-22T03:10:01.686396+0000","last_fullsized":"2024-09-22T03:10:01.686396+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"42'111","reported_seq":124,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.724853+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:10:01.724853+0000","last_peered":"2024-09-22T03:10:01.724853+0000","last_clean":"2024-09-22T03:10:01.724853+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:10:01.724853+0000","last_undegraded":"2024-09-22T03:10:01.724853+0000","last_fullsized":"2024-09-22T03:10:01.724853+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"42'207","reported_seq":220,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.333455+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:10:01.333455+0000","last_peered":"2024-09-22T03:10:01.333455+0000","last_clean":"2024-09-22T03:10:01.333455+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:10:01.333455+0000","last_undegraded":"2024-09-22T03:10:01.333455+0000","last_fullsized":"2024-09-22T03:10:01.333455+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"42'151","reported_seq":164,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.497944+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:10:01.497944+0000","last_peered":"2024-09-22T03:10:01.497944+0000","last_clean":"2024-09-22T03:10:01.497944+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:10:01.497944+0000","last_undegraded":"2024-09-22T03:10:01.497944+0000","last_fullsized":"2024-09-22T03:10:01.497944+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'119","reported_seq":132,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.423579+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:10:01.423579+0000","last_peered":"2024-09-22T03:10:01.423579+0000","last_clean":"2024-09-22T03:10:01.423579+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:10:01.423579+0000","last_undegraded":"2024-09-22T03:10:01.423579+0000","last_fullsized":"2024-09-22T03:10:01.423579+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"42'111","reported_seq":124,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.591282+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:10:01.591282+0000","last_peered":"2024-09-22T03:10:01.591282+0000","last_clean":"2024-09-22T03:10:01.591282+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:10:01.591282+0000","last_undegraded":"2024-09-22T03:10:01.591282+0000","last_fullsized":"2024-09-22T03:10:01.591282+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"42'135","reported_seq":148,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.678768+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:10:01.678768+0000","last_peered":"2024-09-22T03:10:01.678768+0000","last_clean":"2024-09-22T03:10:01.678768+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:10:01.678768+0000","last_undegraded":"2024-09-22T03:10:01.678768+0000","last_fullsized":"2024-09-22T03:10:01.678768+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"42'151","reported_seq":164,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:00.264970+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:10:00.264970+0000","last_peered":"2024-09-22T03:10:00.264970+0000","last_clean":"2024-09-22T03:10:00.264970+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:10:00.264970+0000","last_undegraded":"2024-09-22T03:10:00.264970+0000","last_fullsized":"2024-09-22T03:10:00.264970+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'167","reported_seq":180,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:00.366774+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:10:00.366774+0000","last_peered":"2024-09-22T03:10:00.366774+0000","last_clean":"2024-09-22T03:10:00.366774+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:10:00.366774+0000","last_undegraded":"2024-09-22T03:10:00.366774+0000","last_fullsized":"2024-09-22T03:10:00.366774+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.448786+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:09:54.448786+0000","last_peered":"2024-09-22T03:09:54.448786+0000","last_clean":"2024-09-22T03:09:54.448786+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:09:54.448786+0000","last_undegraded":"2024-09-22T03:09:54.448786+0000","last_fullsized":"2024-09-22T03:09:54.448786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"42'144","reported_seq":157,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.554627+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:10:01.554627+0000","last_peered":"2024-09-22T03:10:01.554627+0000","last_clean":"2024-09-22T03:10:01.554627+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:10:01.554627+0000","last_undegraded":"2024-09-22T03:10:01.554627+0000","last_fullsized":"2024-09-22T03:10:01.554627+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1187840,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":1160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.450212+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:09:54.450212+0000","last_peered":"2024-09-22T03:09:54.450212+0000","last_clean":"2024-09-22T03:09:54.450212+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:09:54.450212+0000","last_undegraded":"2024-09-22T03:09:54.450212+0000","last_fullsized":"2024-09-22T03:09:54.450212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"42'199","reported_seq":212,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.439144+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:10:01.439144+0000","last_peered":"2024-09-22T03:10:01.439144+0000","last_clean":"2024-09-22T03:10:01.439144+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:10:01.439144+0000","last_undegraded":"2024-09-22T03:10:01.439144+0000","last_fullsized":"2024-09-22T03:10:01.439144+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":102,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.451320+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:09:54.451320+0000","last_peered":"2024-09-22T03:09:54.451320+0000","last_clean":"2024-09-22T03:09:54.451320+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:09:54.451320+0000","last_undegraded":"2024-09-22T03:09:54.451320+0000","last_fullsized":"2024-09-22T03:09:54.451320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"42'175","reported_seq":188,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.525655+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:10:01.525655+0000","last_peered":"2024-09-22T03:10:01.525655+0000","last_clean":"2024-09-22T03:10:01.525655+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:10:01.525655+0000","last_undegraded":"2024-09-22T03:10:01.525655+0000","last_fullsized":"2024-09-22T03:10:01.525655+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":101,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453949+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:09:54.453949+0000","last_peered":"2024-09-22T03:09:54.453949+0000","last_clean":"2024-09-22T03:09:54.453949+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:09:54.453949+0000","last_undegraded":"2024-09-22T03:09:54.453949+0000","last_fullsized":"2024-09-22T03:09:54.453949+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":226,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453177+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:09:54.453177+0000","last_peered":"2024-09-22T03:09:54.453177+0000","last_clean":"2024-09-22T03:09:54.453177+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:09:54.453177+0000","last_undegraded":"2024-09-22T03:09:54.453177+0000","last_fullsized":"2024-09-22T03:09:54.453177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"42'135","reported_seq":148,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:00.622091+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:10:00.622091+0000","last_peered":"2024-09-22T03:10:00.622091+0000","last_clean":"2024-09-22T03:10:00.622091+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:10:00.622091+0000","last_undegraded":"2024-09-22T03:10:00.622091+0000","last_fullsized":"2024-09-22T03:10:00.622091+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.454268+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:09:54.454268+0000","last_peered":"2024-09-22T03:09:54.454268+0000","last_clean":"2024-09-22T03:09:54.454268+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:09:54.454268+0000","last_undegraded":"2024-09-22T03:09:54.454268+0000","last_fullsized":"2024-09-22T03:09:54.454268+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"42'191","reported_seq":204,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.470710+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:10:01.470710+0000","last_peered":"2024-09-22T03:10:01.470710+0000","last_clean":"2024-09-22T03:10:01.470710+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:10:01.470710+0000","last_undegraded":"2024-09-22T03:10:01.470710+0000","last_fullsized":"2024-09-22T03:10:01.470710+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.456175+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:09:54.456175+0000","last_peered":"2024-09-22T03:09:54.456175+0000","last_clean":"2024-09-22T03:09:54.456175+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:09:54.456175+0000","last_undegraded":"2024-09-22T03:09:54.456175+0000","last_fullsized":"2024-09-22T03:09:54.456175+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"42'175","reported_seq":188,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.719499+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:10:01.719499+0000","last_peered":"2024-09-22T03:10:01.719499+0000","last_clean":"2024-09-22T03:10:01.719499+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:10:01.719499+0000","last_undegraded":"2024-09-22T03:10:01.719499+0000","last_fullsized":"2024-09-22T03:10:01.719499+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.459126+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:09:54.459126+0000","last_peered":"2024-09-22T03:09:54.459126+0000","last_clean":"2024-09-22T03:09:54.459126+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:09:54.459126+0000","last_undegraded":"2024-09-22T03:09:54.459126+0000","last_fullsized":"2024-09-22T03:09:54.459126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"42'143","reported_seq":156,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:01.642679+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:10:01.642679+0000","last_peered":"2024-09-22T03:10:01.642679+0000","last_clean":"2024-09-22T03:10:01.642679+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:10:01.642679+0000","last_undegraded":"2024-09-22T03:10:01.642679+0000","last_fullsized":"2024-09-22T03:10:01.642679+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.457345+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:09:54.457345+0000","last_peered":"2024-09-22T03:09:54.457345+0000","last_clean":"2024-09-22T03:09:54.457345+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:09:54.457345+0000","last_undegraded":"2024-09-22T03:09:54.457345+0000","last_fullsized":"2024-09-22T03:09:54.457345+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":20389888,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2489,"num_write_kb":19912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30015488,"data_stored":60030976,"data_compressed":3096414,"data_compressed_allocated":30015488,"data_compressed_original":60030976,"omap_allocated":0,"internal_metadata":0},"log_size":2473,"ondisk_log_size":2473,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673304,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114164,"kb_used_data":6820,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94257676,"statfs":{"total":96636764160,"available":96519860224,"internally_reserved":0,"allocated":6983680,"data_stored":13364769,"data_compressed":682840,"data_compressed_allocated":6619136,"data_compressed_original":13238272,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673304,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105360,"kb_used_data":6336,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94266480,"statfs":{"total":96636764160,"available":96528875520,"internally_reserved":0,"allocated":6488064,"data_stored":12841025,"data_compressed":655194,"data_compressed_allocated":6103040,"data_compressed_original":12697600,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673304,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110912,"kb_used_data":7728,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94260928,"statfs":{"total":96636764160,"available":96523190272,"internally_reserved":0,"allocated":7913472,"data_stored":15691841,"data_compressed":802374,"data_compressed_allocated":7528448,"data_compressed_original":15548416,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706008,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110236,"kb_used_data":7052,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94261604,"statfs":{"total":96636764160,"available":96523882496,"internally_reserved":0,"allocated":7221248,"data_stored":14315566,"data_compressed":731174,"data_compressed_allocated":6840320,"data_compressed_original":14172160,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7626752,"data_stored":15253504,"data_compressed":786660,"data_compressed_allocated":7626752,"data_compressed_original":15253504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8286208,"data_stored":16572416,"data_compressed":854899,"data_compressed_allocated":8286208,"data_compressed_original":16572416,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6815744,"data_stored":13631488,"data_compressed":703066,"data_compressed_allocated":6815744,"data_compressed_original":13631488,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7286784,"data_stored":14573568,"data_compressed":751789,"data_compressed_allocated":7286784,"data_compressed_original":14573568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:05.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 11 16 3894 3878 2.75406 2.58594 0.02663 0.0453131 2024-09-22T03:10:05.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:05.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:05.879+0000 7efd4de58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:05.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:05.885+0000 7efd4de58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:06.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 12 16 4212 4196 2.73157 2.48438 0.0212559 0.0455688 2024-09-22T03:10:07.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 13 16 4557 4541 2.72877 2.69531 0.0313749 0.045724 2024-09-22T03:10:08.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:08.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:08.202+0000 7f6068c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:08.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:08.207+0000 7f6068c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:08.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 14 16 4913 4897 2.7325 2.78125 0.0360827 0.0456681 2024-09-22T03:10:09.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 15 16 5270 5254 2.73626 2.78906 0.0637808 0.0455795 2024-09-22T03:10:09.614 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:10:09.615 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:10:09.615 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:09.740+0000 7f40b4757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:09.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:09.751+0000 7f40b4757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:10:10.091 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:10:10.106 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-22T03:10:08.752444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35471923,"num_objects":537,"num_object_clones":0,"num_object_copies":1611,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":4397,"num_write_kb":35960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4342,"ondisk_log_size":4342,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":478668,"kb_used_data":49292,"kb_used_omap":0,"kb_used_meta":429312,"kb_avail":377008692,"statfs":{"total":386547056640,"available":386056900608,"internally_reserved":0,"allocated":50475008,"data_stored":99950289,"data_compressed":5129979,"data_compressed_allocated":48959488,"data_compressed_original":99393536,"omap_allocated":0,"internal_metadata":439615488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29089792,"num_objects":442,"num_object_clones":0,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3551,"num_write_kb":28408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002036"},"pg_stats":[{"pgid":"6.f","version":"42'335","reported_seq":348,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:06.728607+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:10:06.728607+0000","last_peered":"2024-09-22T03:10:06.728607+0000","last_clean":"2024-09-22T03:10:06.728607+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:10:06.728607+0000","last_undegraded":"2024-09-22T03:10:06.728607+0000","last_fullsized":"2024-09-22T03:10:06.728607+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"42'183","reported_seq":196,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:06.590269+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:10:06.590269+0000","last_peered":"2024-09-22T03:10:06.590269+0000","last_clean":"2024-09-22T03:10:06.590269+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:10:06.590269+0000","last_undegraded":"2024-09-22T03:10:06.590269+0000","last_fullsized":"2024-09-22T03:10:06.590269+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"42'359","reported_seq":372,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:06.719113+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:10:06.719113+0000","last_peered":"2024-09-22T03:10:06.719113+0000","last_clean":"2024-09-22T03:10:06.719113+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:10:06.719113+0000","last_undegraded":"2024-09-22T03:10:06.719113+0000","last_fullsized":"2024-09-22T03:10:06.719113+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"42'287","reported_seq":300,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:06.419402+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:10:06.419402+0000","last_peered":"2024-09-22T03:10:06.419402+0000","last_clean":"2024-09-22T03:10:06.419402+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:10:06.419402+0000","last_undegraded":"2024-09-22T03:10:06.419402+0000","last_fullsized":"2024-09-22T03:10:06.419402+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'207","reported_seq":220,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:06.459486+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:10:06.459486+0000","last_peered":"2024-09-22T03:10:06.459486+0000","last_clean":"2024-09-22T03:10:06.459486+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:10:06.459486+0000","last_undegraded":"2024-09-22T03:10:06.459486+0000","last_fullsized":"2024-09-22T03:10:06.459486+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"42'215","reported_seq":228,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:06.656619+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:10:06.656619+0000","last_peered":"2024-09-22T03:10:06.656619+0000","last_clean":"2024-09-22T03:10:06.656619+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:10:06.656619+0000","last_undegraded":"2024-09-22T03:10:06.656619+0000","last_fullsized":"2024-09-22T03:10:06.656619+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"42'287","reported_seq":300,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:06.553428+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:10:06.553428+0000","last_peered":"2024-09-22T03:10:06.553428+0000","last_clean":"2024-09-22T03:10:06.553428+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:10:06.553428+0000","last_undegraded":"2024-09-22T03:10:06.553428+0000","last_fullsized":"2024-09-22T03:10:06.553428+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"42'239","reported_seq":252,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:05.693196+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:10:05.693196+0000","last_peered":"2024-09-22T03:10:05.693196+0000","last_clean":"2024-09-22T03:10:05.693196+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:10:05.693196+0000","last_undegraded":"2024-09-22T03:10:05.693196+0000","last_fullsized":"2024-09-22T03:10:05.693196+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'247","reported_seq":260,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:05.421468+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:10:05.421468+0000","last_peered":"2024-09-22T03:10:05.421468+0000","last_clean":"2024-09-22T03:10:05.421468+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:10:05.421468+0000","last_undegraded":"2024-09-22T03:10:05.421468+0000","last_fullsized":"2024-09-22T03:10:05.421468+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.448786+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:09:54.448786+0000","last_peered":"2024-09-22T03:09:54.448786+0000","last_clean":"2024-09-22T03:09:54.448786+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:09:54.448786+0000","last_undegraded":"2024-09-22T03:09:54.448786+0000","last_fullsized":"2024-09-22T03:09:54.448786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"42'298","reported_seq":311,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:06.740278+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:10:06.740278+0000","last_peered":"2024-09-22T03:10:06.740278+0000","last_clean":"2024-09-22T03:10:06.740278+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:10:06.740278+0000","last_undegraded":"2024-09-22T03:10:06.740278+0000","last_fullsized":"2024-09-22T03:10:06.740278+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449408,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":2392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.450212+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:09:54.450212+0000","last_peered":"2024-09-22T03:09:54.450212+0000","last_clean":"2024-09-22T03:09:54.450212+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:09:54.450212+0000","last_undegraded":"2024-09-22T03:09:54.450212+0000","last_fullsized":"2024-09-22T03:09:54.450212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"42'327","reported_seq":340,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:06.632579+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:10:06.632579+0000","last_peered":"2024-09-22T03:10:06.632579+0000","last_clean":"2024-09-22T03:10:06.632579+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:10:06.632579+0000","last_undegraded":"2024-09-22T03:10:06.632579+0000","last_fullsized":"2024-09-22T03:10:06.632579+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":102,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.451320+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:09:54.451320+0000","last_peered":"2024-09-22T03:09:54.451320+0000","last_clean":"2024-09-22T03:09:54.451320+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:09:54.451320+0000","last_undegraded":"2024-09-22T03:09:54.451320+0000","last_fullsized":"2024-09-22T03:09:54.451320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"42'223","reported_seq":236,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:05.765947+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:10:05.765947+0000","last_peered":"2024-09-22T03:10:05.765947+0000","last_clean":"2024-09-22T03:10:05.765947+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:10:05.765947+0000","last_undegraded":"2024-09-22T03:10:05.765947+0000","last_fullsized":"2024-09-22T03:10:05.765947+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":101,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453949+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:09:54.453949+0000","last_peered":"2024-09-22T03:09:54.453949+0000","last_clean":"2024-09-22T03:09:54.453949+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:09:54.453949+0000","last_undegraded":"2024-09-22T03:09:54.453949+0000","last_fullsized":"2024-09-22T03:09:54.453949+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":226,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453177+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:09:54.453177+0000","last_peered":"2024-09-22T03:09:54.453177+0000","last_clean":"2024-09-22T03:09:54.453177+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:09:54.453177+0000","last_undegraded":"2024-09-22T03:09:54.453177+0000","last_fullsized":"2024-09-22T03:09:54.453177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"42'223","reported_seq":236,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:05.043625+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:10:05.043625+0000","last_peered":"2024-09-22T03:10:05.043625+0000","last_clean":"2024-09-22T03:10:05.043625+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:10:05.043625+0000","last_undegraded":"2024-09-22T03:10:05.043625+0000","last_fullsized":"2024-09-22T03:10:05.043625+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.454268+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:09:54.454268+0000","last_peered":"2024-09-22T03:09:54.454268+0000","last_clean":"2024-09-22T03:09:54.454268+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:09:54.454268+0000","last_undegraded":"2024-09-22T03:09:54.454268+0000","last_fullsized":"2024-09-22T03:09:54.454268+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"42'287","reported_seq":300,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:05.829705+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:10:05.829705+0000","last_peered":"2024-09-22T03:10:05.829705+0000","last_clean":"2024-09-22T03:10:05.829705+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:10:05.829705+0000","last_undegraded":"2024-09-22T03:10:05.829705+0000","last_fullsized":"2024-09-22T03:10:05.829705+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.456175+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:09:54.456175+0000","last_peered":"2024-09-22T03:09:54.456175+0000","last_clean":"2024-09-22T03:09:54.456175+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:09:54.456175+0000","last_undegraded":"2024-09-22T03:09:54.456175+0000","last_fullsized":"2024-09-22T03:09:54.456175+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"42'279","reported_seq":292,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:06.450959+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:10:06.450959+0000","last_peered":"2024-09-22T03:10:06.450959+0000","last_clean":"2024-09-22T03:10:06.450959+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:10:06.450959+0000","last_undegraded":"2024-09-22T03:10:06.450959+0000","last_fullsized":"2024-09-22T03:10:06.450959+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.459126+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:09:54.459126+0000","last_peered":"2024-09-22T03:09:54.459126+0000","last_clean":"2024-09-22T03:09:54.459126+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:09:54.459126+0000","last_undegraded":"2024-09-22T03:09:54.459126+0000","last_fullsized":"2024-09-22T03:09:54.459126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"42'246","reported_seq":259,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:06.731872+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:10:06.731872+0000","last_peered":"2024-09-22T03:10:06.731872+0000","last_clean":"2024-09-22T03:10:06.731872+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:10:06.731872+0000","last_undegraded":"2024-09-22T03:10:06.731872+0000","last_fullsized":"2024-09-22T03:10:06.731872+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2023424,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":1976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.457345+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:09:54.457345+0000","last_peered":"2024-09-22T03:09:54.457345+0000","last_clean":"2024-09-22T03:09:54.457345+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:09:54.457345+0000","last_undegraded":"2024-09-22T03:09:54.457345+0000","last_fullsized":"2024-09-22T03:09:54.457345+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":34881536,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4258,"num_write_kb":34064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51720192,"data_stored":103440384,"data_compressed":5337891,"data_compressed_allocated":51720192,"data_compressed_original":103440384,"omap_allocated":0,"internal_metadata":0},"log_size":4242,"ondisk_log_size":4242,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673309,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123188,"kb_used_data":11684,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94248652,"statfs":{"total":96636764160,"available":96510619648,"internally_reserved":0,"allocated":11964416,"data_stored":23326241,"data_compressed":1197208,"data_compressed_allocated":11599872,"data_compressed_original":23199744,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673309,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114396,"kb_used_data":11212,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94257444,"statfs":{"total":96636764160,"available":96519622656,"internally_reserved":0,"allocated":11481088,"data_stored":22827073,"data_compressed":1170831,"data_compressed_allocated":11096064,"data_compressed_original":22683648,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673309,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120848,"kb_used_data":13504,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94250992,"statfs":{"total":96636764160,"available":96513015808,"internally_reserved":0,"allocated":13828096,"data_stored":27521089,"data_compressed":1413186,"data_compressed_allocated":13443072,"data_compressed_original":27377664,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706013,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120236,"kb_used_data":12892,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94251604,"statfs":{"total":96636764160,"available":96513642496,"internally_reserved":0,"allocated":13201408,"data_stored":26275886,"data_compressed":1348754,"data_compressed_allocated":12820480,"data_compressed_original":26132480,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13369344,"data_stored":26738688,"data_compressed":1379706,"data_compressed_allocated":13369344,"data_compressed_original":26738688,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14155776,"data_stored":28311552,"data_compressed":1461058,"data_compressed_allocated":14155776,"data_compressed_original":28311552,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11960320,"data_stored":23920640,"data_compressed":1234354,"data_compressed_allocated":11960320,"data_compressed_original":23920640,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12234752,"data_stored":24469504,"data_compressed":1262773,"data_compressed_allocated":12234752,"data_compressed_original":24469504,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:10.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:10.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:10.483+0000 7f3293f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:10.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:10.489+0000 7f3293f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:10.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 16 16 5581 5565 2.71709 2.42969 0.0662116 0.045912 2024-09-22T03:10:11.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 17 16 5926 5910 2.71579 2.69531 0.0499562 0.0459529 2024-09-22T03:10:12.526 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 18 16 6258 6242 2.709 2.59375 0.0755115 0.0460725 2024-09-22T03:10:12.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:12.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:12.828+0000 7f6ac602c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:12.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:12.835+0000 7f6ac602c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:13.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 19 16 6566 6550 2.69306 2.40625 0.0258516 0.0463375 2024-09-22T03:10:14.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:10:14.526191+0000 min lat: 0.0086963 max lat: 0.153051 avg lat: 0.0463211 2024-09-22T03:10:14.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:10:14.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 20 15 6916 6901 2.6955 2.74219 0.0489872 0.0463211 2024-09-22T03:10:14.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:15.102+0000 7fb5698d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.109 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:10:15.109 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:10:15.109 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:15.109+0000 7fb5698d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:15.260+0000 7faee3197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:15.270+0000 7faee1f35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 21 16 7205 7189 2.67428 2.25 0.039432 0.0466538 2024-09-22T03:10:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:10:15.567 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:10:15.584 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-09-22T03:10:14.753509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":49340979,"num_objects":749,"num_object_clones":0,"num_object_copies":2247,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":6090,"num_write_kb":49504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6035,"ondisk_log_size":6035,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":502892,"kb_used_data":69356,"kb_used_omap":0,"kb_used_meta":433472,"kb_avail":376984468,"statfs":{"total":386547056640,"available":386032095232,"internally_reserved":0,"allocated":71020544,"data_stored":141041361,"data_compressed":7251747,"data_compressed_allocated":69505024,"data_compressed_original":140484608,"omap_allocated":0,"internal_metadata":443875328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28360704,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3462,"num_write_kb":27696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002141"},"pg_stats":[{"pgid":"6.f","version":"42'423","reported_seq":436,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.472859+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:10:11.472859+0000","last_peered":"2024-09-22T03:10:11.472859+0000","last_clean":"2024-09-22T03:10:11.472859+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:10:11.472859+0000","last_undegraded":"2024-09-22T03:10:11.472859+0000","last_fullsized":"2024-09-22T03:10:11.472859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"42'279","reported_seq":292,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.377295+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:10:11.377295+0000","last_peered":"2024-09-22T03:10:11.377295+0000","last_clean":"2024-09-22T03:10:11.377295+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:10:11.377295+0000","last_undegraded":"2024-09-22T03:10:11.377295+0000","last_fullsized":"2024-09-22T03:10:11.377295+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"42'420","reported_seq":433,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.726351+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:10:11.726351+0000","last_peered":"2024-09-22T03:10:11.726351+0000","last_clean":"2024-09-22T03:10:11.726351+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:10:11.726351+0000","last_undegraded":"2024-09-22T03:10:11.726351+0000","last_fullsized":"2024-09-22T03:10:11.726351+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3448832,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":3368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"42'359","reported_seq":372,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.488138+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:10:11.488138+0000","last_peered":"2024-09-22T03:10:11.488138+0000","last_clean":"2024-09-22T03:10:11.488138+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:10:11.488138+0000","last_undegraded":"2024-09-22T03:10:11.488138+0000","last_fullsized":"2024-09-22T03:10:11.488138+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'319","reported_seq":332,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.564705+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:10:11.564705+0000","last_peered":"2024-09-22T03:10:11.564705+0000","last_clean":"2024-09-22T03:10:11.564705+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:10:11.564705+0000","last_undegraded":"2024-09-22T03:10:11.564705+0000","last_fullsized":"2024-09-22T03:10:11.564705+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"42'303","reported_seq":316,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.824228+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:10:10.824228+0000","last_peered":"2024-09-22T03:10:10.824228+0000","last_clean":"2024-09-22T03:10:10.824228+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:10:10.824228+0000","last_undegraded":"2024-09-22T03:10:10.824228+0000","last_fullsized":"2024-09-22T03:10:10.824228+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"42'399","reported_seq":412,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.680852+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:10:11.680852+0000","last_peered":"2024-09-22T03:10:11.680852+0000","last_clean":"2024-09-22T03:10:11.680852+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:10:11.680852+0000","last_undegraded":"2024-09-22T03:10:11.680852+0000","last_fullsized":"2024-09-22T03:10:11.680852+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"42'356","reported_seq":369,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.737284+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:10:10.737284+0000","last_peered":"2024-09-22T03:10:10.737284+0000","last_clean":"2024-09-22T03:10:10.737284+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:10:10.737284+0000","last_undegraded":"2024-09-22T03:10:10.737284+0000","last_fullsized":"2024-09-22T03:10:10.737284+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2924544,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":2856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'391","reported_seq":404,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.576603+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:10:10.576603+0000","last_peered":"2024-09-22T03:10:10.576603+0000","last_clean":"2024-09-22T03:10:10.576603+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:10:10.576603+0000","last_undegraded":"2024-09-22T03:10:10.576603+0000","last_fullsized":"2024-09-22T03:10:10.576603+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.448786+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:09:54.448786+0000","last_peered":"2024-09-22T03:09:54.448786+0000","last_clean":"2024-09-22T03:09:54.448786+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:09:54.448786+0000","last_undegraded":"2024-09-22T03:09:54.448786+0000","last_fullsized":"2024-09-22T03:09:54.448786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"42'407","reported_seq":420,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.463250+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:10:11.463250+0000","last_peered":"2024-09-22T03:10:11.463250+0000","last_clean":"2024-09-22T03:10:11.463250+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:10:11.463250+0000","last_undegraded":"2024-09-22T03:10:11.463250+0000","last_fullsized":"2024-09-22T03:10:11.463250+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.450212+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:09:54.450212+0000","last_peered":"2024-09-22T03:09:54.450212+0000","last_clean":"2024-09-22T03:09:54.450212+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:09:54.450212+0000","last_undegraded":"2024-09-22T03:09:54.450212+0000","last_fullsized":"2024-09-22T03:09:54.450212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"42'471","reported_seq":484,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.332281+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:10:11.332281+0000","last_peered":"2024-09-22T03:10:11.332281+0000","last_clean":"2024-09-22T03:10:11.332281+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:10:11.332281+0000","last_undegraded":"2024-09-22T03:10:11.332281+0000","last_fullsized":"2024-09-22T03:10:11.332281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":102,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.451320+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:09:54.451320+0000","last_peered":"2024-09-22T03:09:54.451320+0000","last_clean":"2024-09-22T03:09:54.451320+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:09:54.451320+0000","last_undegraded":"2024-09-22T03:09:54.451320+0000","last_fullsized":"2024-09-22T03:09:54.451320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"42'340","reported_seq":353,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.739390+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:10:11.739390+0000","last_peered":"2024-09-22T03:10:11.739390+0000","last_clean":"2024-09-22T03:10:11.739390+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:10:11.739390+0000","last_undegraded":"2024-09-22T03:10:11.739390+0000","last_fullsized":"2024-09-22T03:10:11.739390+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2793472,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":2728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":101,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453949+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:09:54.453949+0000","last_peered":"2024-09-22T03:09:54.453949+0000","last_clean":"2024-09-22T03:09:54.453949+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:09:54.453949+0000","last_undegraded":"2024-09-22T03:09:54.453949+0000","last_fullsized":"2024-09-22T03:09:54.453949+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":226,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453177+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:09:54.453177+0000","last_peered":"2024-09-22T03:09:54.453177+0000","last_clean":"2024-09-22T03:09:54.453177+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:09:54.453177+0000","last_undegraded":"2024-09-22T03:09:54.453177+0000","last_fullsized":"2024-09-22T03:09:54.453177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"42'319","reported_seq":332,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.651246+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:10:10.651246+0000","last_peered":"2024-09-22T03:10:10.651246+0000","last_clean":"2024-09-22T03:10:10.651246+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:10:10.651246+0000","last_undegraded":"2024-09-22T03:10:10.651246+0000","last_fullsized":"2024-09-22T03:10:10.651246+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.454268+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:09:54.454268+0000","last_peered":"2024-09-22T03:09:54.454268+0000","last_clean":"2024-09-22T03:09:54.454268+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:09:54.454268+0000","last_undegraded":"2024-09-22T03:09:54.454268+0000","last_fullsized":"2024-09-22T03:09:54.454268+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"42'439","reported_seq":452,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.712899+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:10:11.712899+0000","last_peered":"2024-09-22T03:10:11.712899+0000","last_clean":"2024-09-22T03:10:11.712899+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:10:11.712899+0000","last_undegraded":"2024-09-22T03:10:11.712899+0000","last_fullsized":"2024-09-22T03:10:11.712899+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.456175+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:09:54.456175+0000","last_peered":"2024-09-22T03:09:54.456175+0000","last_clean":"2024-09-22T03:09:54.456175+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:09:54.456175+0000","last_undegraded":"2024-09-22T03:09:54.456175+0000","last_fullsized":"2024-09-22T03:09:54.456175+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"42'359","reported_seq":372,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.596694+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:10:11.596694+0000","last_peered":"2024-09-22T03:10:11.596694+0000","last_clean":"2024-09-22T03:10:11.596694+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:10:11.596694+0000","last_undegraded":"2024-09-22T03:10:11.596694+0000","last_fullsized":"2024-09-22T03:10:11.596694+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.459126+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:09:54.459126+0000","last_peered":"2024-09-22T03:09:54.459126+0000","last_clean":"2024-09-22T03:09:54.459126+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:09:54.459126+0000","last_undegraded":"2024-09-22T03:09:54.459126+0000","last_fullsized":"2024-09-22T03:09:54.459126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"42'351","reported_seq":364,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:11.431737+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:10:11.431737+0000","last_peered":"2024-09-22T03:10:11.431737+0000","last_clean":"2024-09-22T03:10:11.431737+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:10:11.431737+0000","last_undegraded":"2024-09-22T03:10:11.431737+0000","last_fullsized":"2024-09-22T03:10:11.431737+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.457345+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:09:54.457345+0000","last_peered":"2024-09-22T03:09:54.457345+0000","last_clean":"2024-09-22T03:09:54.457345+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:09:54.457345+0000","last_undegraded":"2024-09-22T03:09:54.457345+0000","last_fullsized":"2024-09-22T03:09:54.457345+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":48750592,"num_objects":745,"num_object_clones":0,"num_object_copies":2235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5951,"num_write_kb":47608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72572928,"data_stored":145145856,"data_compressed":7491384,"data_compressed_allocated":72572928,"data_compressed_original":145145856,"omap_allocated":0,"internal_metadata":0},"log_size":5935,"ondisk_log_size":5935,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673314,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115384,"kb_used_data":16360,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94256456,"statfs":{"total":96636764160,"available":96518610944,"internally_reserved":0,"allocated":16752640,"data_stored":32902689,"data_compressed":1691695,"data_compressed_allocated":16388096,"data_compressed_original":32776192,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673314,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123280,"kb_used_data":15936,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94248560,"statfs":{"total":96636764160,"available":96510525440,"internally_reserved":0,"allocated":16318464,"data_stored":32501825,"data_compressed":1670394,"data_compressed_allocated":15933440,"data_compressed_original":32358400,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673314,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130272,"kb_used_data":18768,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94241568,"statfs":{"total":96636764160,"available":96503365632,"internally_reserved":0,"allocated":19218432,"data_stored":38301761,"data_compressed":1969854,"data_compressed_allocated":18833408,"data_compressed_original":38158336,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706018,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133956,"kb_used_data":18292,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94237884,"statfs":{"total":96636764160,"available":96499593216,"internally_reserved":0,"allocated":18731008,"data_stored":37335086,"data_compressed":1919804,"data_compressed_allocated":18350080,"data_compressed_original":37191680,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19046400,"data_stored":38092800,"data_compressed":1965984,"data_compressed_allocated":19046400,"data_compressed_original":38092800,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19587072,"data_stored":39174144,"data_compressed":2021956,"data_compressed_allocated":19587072,"data_compressed_original":39174144,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":33554432,"data_compressed":1731802,"data_compressed_allocated":16777216,"data_compressed_original":33554432,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17162240,"data_stored":34324480,"data_compressed":1771642,"data_compressed_allocated":17162240,"data_compressed_original":34324480,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:16.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 22 16 7536 7520 2.67025 2.58594 0.0192785 0.0467503 2024-09-22T03:10:17.313 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:17.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:17.444+0000 7fa3c5f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:17.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:17.450+0000 7fa3c5f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:17.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 23 16 7856 7840 2.66284 2.5 0.0618746 0.0468623 2024-09-22T03:10:18.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 24 16 8169 8153 2.65377 2.44531 0.0858905 0.0470242 2024-09-22T03:10:19.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 25 16 8485 8469 2.64636 2.46875 0.027028 0.0471859 2024-09-22T03:10:19.606 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:19.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:19.757+0000 7f0d6af97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:19.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:19.763+0000 7f0d6af97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:20.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 26 16 8798 8782 2.63862 2.44531 0.0602545 0.0473262 2024-09-22T03:10:20.586 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:10:20.586 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:10:20.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:20.711+0000 7feeaaf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:20.718+0000 7feeaaf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:20.936 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:10:20.937 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:10:20.957 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-09-22T03:10:20.754543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":64979507,"num_objects":987,"num_object_clones":0,"num_object_copies":2961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7999,"num_write_kb":64776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7944,"ondisk_log_size":7944,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":537408,"kb_used_data":94140,"kb_used_omap":0,"kb_used_meta":443200,"kb_avail":376949952,"statfs":{"total":386547056640,"available":385996750848,"internally_reserved":0,"allocated":96399360,"data_stored":191798993,"data_compressed":9872655,"data_compressed_allocated":94883840,"data_compressed_original":191242240,"omap_allocated":0,"internal_metadata":453836800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29507584,"num_objects":450,"num_object_clones":0,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3602,"num_write_kb":28816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002099"},"pg_stats":[{"pgid":"6.f","version":"42'531","reported_seq":544,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.727196+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:10:16.727196+0000","last_peered":"2024-09-22T03:10:16.727196+0000","last_clean":"2024-09-22T03:10:16.727196+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:10:16.727196+0000","last_undegraded":"2024-09-22T03:10:16.727196+0000","last_fullsized":"2024-09-22T03:10:16.727196+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4358144,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"42'367","reported_seq":380,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.619745+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:10:16.619745+0000","last_peered":"2024-09-22T03:10:16.619745+0000","last_clean":"2024-09-22T03:10:16.619745+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:10:16.619745+0000","last_undegraded":"2024-09-22T03:10:16.619745+0000","last_fullsized":"2024-09-22T03:10:16.619745+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"42'559","reported_seq":572,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.732371+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:10:16.732371+0000","last_peered":"2024-09-22T03:10:16.732371+0000","last_clean":"2024-09-22T03:10:16.732371+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:10:16.732371+0000","last_undegraded":"2024-09-22T03:10:16.732371+0000","last_fullsized":"2024-09-22T03:10:16.732371+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"42'439","reported_seq":452,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.525746+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:10:16.525746+0000","last_peered":"2024-09-22T03:10:16.525746+0000","last_clean":"2024-09-22T03:10:16.525746+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:10:16.525746+0000","last_undegraded":"2024-09-22T03:10:16.525746+0000","last_fullsized":"2024-09-22T03:10:16.525746+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'407","reported_seq":420,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.273565+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:10:16.273565+0000","last_peered":"2024-09-22T03:10:16.273565+0000","last_clean":"2024-09-22T03:10:16.273565+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:10:16.273565+0000","last_undegraded":"2024-09-22T03:10:16.273565+0000","last_fullsized":"2024-09-22T03:10:16.273565+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"42'439","reported_seq":452,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.224771+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:10:16.224771+0000","last_peered":"2024-09-22T03:10:16.224771+0000","last_clean":"2024-09-22T03:10:16.224771+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:10:16.224771+0000","last_undegraded":"2024-09-22T03:10:16.224771+0000","last_fullsized":"2024-09-22T03:10:16.224771+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"42'551","reported_seq":564,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.400825+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:10:16.400825+0000","last_peered":"2024-09-22T03:10:16.400825+0000","last_clean":"2024-09-22T03:10:16.400825+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:10:16.400825+0000","last_undegraded":"2024-09-22T03:10:16.400825+0000","last_fullsized":"2024-09-22T03:10:16.400825+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"42'575","reported_seq":588,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:19.837643+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:10:19.837643+0000","last_peered":"2024-09-22T03:10:19.837643+0000","last_clean":"2024-09-22T03:10:19.837643+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:10:19.837643+0000","last_undegraded":"2024-09-22T03:10:19.837643+0000","last_fullsized":"2024-09-22T03:10:19.837643+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'583","reported_seq":596,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:20.488355+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:10:20.488355+0000","last_peered":"2024-09-22T03:10:20.488355+0000","last_clean":"2024-09-22T03:10:20.488355+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:10:20.488355+0000","last_undegraded":"2024-09-22T03:10:20.488355+0000","last_fullsized":"2024-09-22T03:10:20.488355+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.448786+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:09:54.448786+0000","last_peered":"2024-09-22T03:09:54.448786+0000","last_clean":"2024-09-22T03:09:54.448786+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:09:54.448786+0000","last_undegraded":"2024-09-22T03:09:54.448786+0000","last_fullsized":"2024-09-22T03:09:54.448786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"42'439","reported_seq":452,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:14.877102+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:10:14.877102+0000","last_peered":"2024-09-22T03:10:14.877102+0000","last_clean":"2024-09-22T03:10:14.877102+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:10:14.877102+0000","last_undegraded":"2024-09-22T03:10:14.877102+0000","last_fullsized":"2024-09-22T03:10:14.877102+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.450212+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:09:54.450212+0000","last_peered":"2024-09-22T03:09:54.450212+0000","last_clean":"2024-09-22T03:09:54.450212+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:09:54.450212+0000","last_undegraded":"2024-09-22T03:09:54.450212+0000","last_fullsized":"2024-09-22T03:09:54.450212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"42'535","reported_seq":548,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.363580+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:10:16.363580+0000","last_peered":"2024-09-22T03:10:16.363580+0000","last_clean":"2024-09-22T03:10:16.363580+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:10:16.363580+0000","last_undegraded":"2024-09-22T03:10:16.363580+0000","last_fullsized":"2024-09-22T03:10:16.363580+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":102,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.451320+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:09:54.451320+0000","last_peered":"2024-09-22T03:09:54.451320+0000","last_clean":"2024-09-22T03:09:54.451320+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:09:54.451320+0000","last_undegraded":"2024-09-22T03:09:54.451320+0000","last_fullsized":"2024-09-22T03:09:54.451320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"42'431","reported_seq":444,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.154071+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:10:16.154071+0000","last_peered":"2024-09-22T03:10:16.154071+0000","last_clean":"2024-09-22T03:10:16.154071+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:10:16.154071+0000","last_undegraded":"2024-09-22T03:10:16.154071+0000","last_fullsized":"2024-09-22T03:10:16.154071+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":101,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453949+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:09:54.453949+0000","last_peered":"2024-09-22T03:09:54.453949+0000","last_clean":"2024-09-22T03:09:54.453949+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:09:54.453949+0000","last_undegraded":"2024-09-22T03:09:54.453949+0000","last_fullsized":"2024-09-22T03:09:54.453949+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":226,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453177+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:09:54.453177+0000","last_peered":"2024-09-22T03:09:54.453177+0000","last_clean":"2024-09-22T03:09:54.453177+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:09:54.453177+0000","last_undegraded":"2024-09-22T03:09:54.453177+0000","last_fullsized":"2024-09-22T03:09:54.453177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"42'535","reported_seq":548,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:20.314959+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:10:20.314959+0000","last_peered":"2024-09-22T03:10:20.314959+0000","last_clean":"2024-09-22T03:10:20.314959+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:10:20.314959+0000","last_undegraded":"2024-09-22T03:10:20.314959+0000","last_fullsized":"2024-09-22T03:10:20.314959+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.454268+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:09:54.454268+0000","last_peered":"2024-09-22T03:09:54.454268+0000","last_clean":"2024-09-22T03:09:54.454268+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:09:54.454268+0000","last_undegraded":"2024-09-22T03:09:54.454268+0000","last_fullsized":"2024-09-22T03:09:54.454268+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"42'527","reported_seq":540,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.027396+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:10:16.027396+0000","last_peered":"2024-09-22T03:10:16.027396+0000","last_clean":"2024-09-22T03:10:16.027396+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:10:16.027396+0000","last_undegraded":"2024-09-22T03:10:16.027396+0000","last_fullsized":"2024-09-22T03:10:16.027396+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.456175+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:09:54.456175+0000","last_peered":"2024-09-22T03:09:54.456175+0000","last_clean":"2024-09-22T03:09:54.456175+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:09:54.456175+0000","last_undegraded":"2024-09-22T03:09:54.456175+0000","last_fullsized":"2024-09-22T03:09:54.456175+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"42'447","reported_seq":460,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.680696+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:10:16.680696+0000","last_peered":"2024-09-22T03:10:16.680696+0000","last_clean":"2024-09-22T03:10:16.680696+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:10:16.680696+0000","last_undegraded":"2024-09-22T03:10:16.680696+0000","last_fullsized":"2024-09-22T03:10:16.680696+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.459126+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:09:54.459126+0000","last_peered":"2024-09-22T03:09:54.459126+0000","last_clean":"2024-09-22T03:09:54.459126+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:09:54.459126+0000","last_undegraded":"2024-09-22T03:09:54.459126+0000","last_fullsized":"2024-09-22T03:09:54.459126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"42'479","reported_seq":492,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.204954+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:10:16.204954+0000","last_peered":"2024-09-22T03:10:16.204954+0000","last_clean":"2024-09-22T03:10:16.204954+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:10:16.204954+0000","last_undegraded":"2024-09-22T03:10:16.204954+0000","last_fullsized":"2024-09-22T03:10:16.204954+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.457345+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:09:54.457345+0000","last_peered":"2024-09-22T03:09:54.457345+0000","last_clean":"2024-09-22T03:09:54.457345+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:09:54.457345+0000","last_undegraded":"2024-09-22T03:09:54.457345+0000","last_fullsized":"2024-09-22T03:09:54.457345+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":64389120,"num_objects":983,"num_object_clones":0,"num_object_copies":2949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7860,"num_write_kb":62880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97521664,"data_stored":195043328,"data_compressed":10067877,"data_compressed_allocated":97521664,"data_compressed_original":195043328,"omap_allocated":0,"internal_metadata":0},"log_size":7844,"ondisk_log_size":7844,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142156,"kb_used_data":20924,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94229684,"statfs":{"total":96636764160,"available":96491196416,"internally_reserved":0,"allocated":21426176,"data_stored":42249761,"data_compressed":2174338,"data_compressed_allocated":21061632,"data_compressed_original":42123264,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132072,"kb_used_data":20568,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94239768,"statfs":{"total":96636764160,"available":96501522432,"internally_reserved":0,"allocated":21061632,"data_stored":41988161,"data_compressed":2160228,"data_compressed_allocated":20676608,"data_compressed_original":41844736,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127136,"kb_used_data":23948,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94244704,"statfs":{"total":96636764160,"available":96506576896,"internally_reserved":0,"allocated":24522752,"data_stored":48910401,"data_compressed":2517639,"data_compressed_allocated":24137728,"data_compressed_original":48766976,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":136044,"kb_used_data":28700,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94235796,"statfs":{"total":96636764160,"available":96497455104,"internally_reserved":0,"allocated":29388800,"data_stored":58650670,"data_compressed":3020450,"data_compressed_allocated":29007872,"data_compressed_original":58507264,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29609984,"data_stored":59219968,"data_compressed":3056901,"data_compressed_allocated":29609984,"data_compressed_original":59219968,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24854528,"data_stored":49709056,"data_compressed":2565934,"data_compressed_allocated":24854528,"data_compressed_original":49709056,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21446656,"data_stored":42893312,"data_compressed":2214022,"data_compressed_allocated":21446656,"data_compressed_original":42893312,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21610496,"data_stored":43220992,"data_compressed":2231020,"data_compressed_allocated":21610496,"data_compressed_original":43220992,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:21.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 27 16 9120 9104 2.63406 2.51562 0.0858208 0.0473855 2024-09-22T03:10:21.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:22.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:22.007+0000 7f8eb642c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:22.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:22.015+0000 7f8eb642c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:22.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 28 16 9418 9402 2.62312 2.32812 0.049238 0.0475852 2024-09-22T03:10:23.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 29 16 9729 9713 2.61645 2.42969 0.0352448 0.0477272 2024-09-22T03:10:24.184 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:24.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:24.299+0000 7f0f57317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:24.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:24.305+0000 7f0f57317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:24.527 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 30 16 10035 10019 2.60892 2.39062 0.0361971 0.0478894 2024-09-22T03:10:25.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 31 16 10348 10332 2.60363 2.44531 0.095086 0.0479486 2024-09-22T03:10:25.959 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:10:25.959 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:10:25.960 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:10:25.960 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:10:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:26.107+0000 7f76a4d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:26.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:26.117+0000 7f76a4d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:26.135 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:26.135 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:26.139 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:26.139 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:26.140 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:10:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:26.269+0000 7fc4f7e58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:26.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:26.278+0000 7fc4f7e58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:26.354 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:26.354 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:26.354 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:26.354 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:26.355 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:26.355 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:26.355 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:26.355 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:26.355 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:26.355 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:26.355 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:26.355 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:26.358 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:26.358 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:26.358 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:10:26.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:26.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:26.492+0000 7f9a17357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:26.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:26.505+0000 7f9a17357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:26.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 32 16 10657 10641 2.5977 2.41406 0.0273852 0.0480427 2024-09-22T03:10:26.530 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:26.530 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:26.530 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:26.530 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:26.530 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:26.530 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:26.530 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:26.531 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:26.531 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:26.531 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:26.531 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:26.531 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:26.534 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:26.535 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:26.535 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:10:26.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:26.614+0000 7f7bfa42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:26.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:26.622+0000 7f7bfa42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:26.716+0000 7f56ba317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:26.728+0000 7f56ba317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:26.751 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:26.751 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:26.751 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:26.751 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:26.751 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:26.751 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:26.751 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:26.751 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:26.751 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:26.751 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:26.751 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:26.752 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:26.755 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:26.755 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:27.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 33 16 10950 10934 2.58835 2.28906 0.035743 0.0482608 2024-09-22T03:10:28.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 34 16 11255 11239 2.58229 2.38281 0.0579525 0.0483574 2024-09-22T03:10:28.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:28.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:28.907+0000 7f1c67b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:28.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:28.915+0000 7f1c67b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:29.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 35 16 11541 11525 2.57235 2.23438 0.0428375 0.0485516 2024-09-22T03:10:30.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 36 16 11834 11818 2.56447 2.28906 0.0545529 0.0486794 2024-09-22T03:10:31.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:31.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:31.187+0000 7fdf94757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:31.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:31.192+0000 7fdf94757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:31.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 37 16 12130 12114 2.55766 2.3125 0.0450827 0.0488188 2024-09-22T03:10:31.756 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:10:31.756 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:10:31.756 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:10:31.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:10:31.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:31.893+0000 7f5557397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:31.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:31.905+0000 7f5557397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:31.927 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:31.927 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:31.927 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:31.928 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:31.928 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:31.928 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:31.928 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:31.928 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:31.928 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:31.928 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:31.928 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:31.928 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:31.932 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:31.934 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:31.934 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:10:32.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:32.066+0000 7f8c74f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:32.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:32.079+0000 7f8c74f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:32.115 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:32.116 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:32.116 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:32.116 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:32.116 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:32.116 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:32.116 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:32.116 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:32.116 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:32.116 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:32.116 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:32.116 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:32.119 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:32.119 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:32.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:10:32.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:32.235+0000 7f3b686d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:32.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:32.248+0000 7f3b686d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:32.274 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:32.274 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:32.274 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:32.275 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:32.275 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:32.275 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:32.275 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:32.275 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:32.275 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:32.275 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:32.275 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:32.275 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:32.278 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:32.278 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:32.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:10:32.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:32.410+0000 7fc21526c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:32.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:32.420+0000 7fc21526c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:32.442 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:32.442 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:32.442 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:32.442 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:32.442 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:32.446 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:32.446 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:32.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 38 16 12419 12403 2.54976 2.25781 0.0576745 0.0489717 2024-09-22T03:10:33.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:33.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:33.493+0000 7f074a997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:33.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:33.499+0000 7f074a997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:33.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 39 16 12719 12703 2.54448 2.34375 0.0329701 0.0490517 2024-09-22T03:10:34.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:10:34.527765+0000 min lat: 0.0086963 max lat: 0.153051 avg lat: 0.0492037 2024-09-22T03:10:34.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:10:34.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 40 16 13015 12999 2.53867 2.3125 0.0254215 0.0492037 2024-09-22T03:10:35.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 41 16 13322 13306 2.53525 2.39844 0.0836201 0.0492604 2024-09-22T03:10:35.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:35.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:35.790+0000 7ff17d66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:35.798+0000 7ff17d66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:36.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 42 16 13594 13578 2.52547 2.125 0.0428691 0.0494375 2024-09-22T03:10:37.447 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:10:37.447 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:10:37.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 43 16 13911 13895 2.52433 2.47656 0.105591 0.0494833 2024-09-22T03:10:37.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:37.584+0000 7efec4317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:37.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:37.599+0000 7efec4317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:38.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:38.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:38.165+0000 7f52ebd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:38.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:38.170+0000 7f52ebd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:38.430 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:10:38.447 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:10:38.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 44 16 14178 14162 2.51436 2.08594 0.0417649 0.0496625 2024-09-22T03:10:38.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:38.637+0000 7fb2d0ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:38.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:38.651+0000 7fb2d0ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:39.436 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:10:39.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:10:39.528 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 45 16 14445 14429 2.50484 2.08594 0.0673265 0.0498605 2024-09-22T03:10:39.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:39.617+0000 7f7e126b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:39.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:39.630+0000 7f7e126b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:40.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:40.436 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:10:40.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:10:40.529 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 46 16 14698 14682 2.49335 1.97656 0.0119504 0.0500688 2024-09-22T03:10:40.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:40.545+0000 7ffb2e197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:40.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:40.553+0000 7ffb2cf35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:40.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:40.639+0000 7f8aa0b4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:40.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:40.653+0000 7f8aa0b4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:41.442 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:10:41.461 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:10:41.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:41.529 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 47 16 14945 14929 2.48136 1.92969 0.0505963 0.0503384 2024-09-22T03:10:41.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:41.586+0000 7f21b50d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:41.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:41.596+0000 7f21b50d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:10:41.907 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:10:41.927 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-09-22T03:10:41.441839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":113910323,"num_objects":1734,"num_object_clones":0,"num_object_copies":5202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":13972,"num_write_kb":112560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13918,"ondisk_log_size":13918,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":654432,"kb_used_data":166752,"kb_used_omap":0,"kb_used_meta":487616,"kb_avail":376832928,"statfs":{"total":386547056640,"available":385876918272,"internally_reserved":0,"allocated":170754048,"data_stored":340482147,"data_compressed":17549679,"data_compressed_allocated":169222144,"data_compressed_original":339918848,"omap_allocated":0,"internal_metadata":499318784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5087232,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":621,"num_write_kb":4968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.684423"},"pg_stats":[{"pgid":"6.f","version":"42'879","reported_seq":892,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:35.374302+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:10:35.374302+0000","last_peered":"2024-09-22T03:10:35.374302+0000","last_clean":"2024-09-22T03:10:35.374302+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:10:35.374302+0000","last_undegraded":"2024-09-22T03:10:35.374302+0000","last_fullsized":"2024-09-22T03:10:35.374302+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"42'791","reported_seq":804,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.718541+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:10:36.718541+0000","last_peered":"2024-09-22T03:10:36.718541+0000","last_clean":"2024-09-22T03:10:36.718541+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:10:36.718541+0000","last_undegraded":"2024-09-22T03:10:36.718541+0000","last_fullsized":"2024-09-22T03:10:36.718541+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"42'1023","reported_seq":1036,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.538545+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:10:36.538545+0000","last_peered":"2024-09-22T03:10:36.538545+0000","last_clean":"2024-09-22T03:10:36.538545+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:10:36.538545+0000","last_undegraded":"2024-09-22T03:10:36.538545+0000","last_fullsized":"2024-09-22T03:10:36.538545+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"42'807","reported_seq":820,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.731332+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:10:36.731332+0000","last_peered":"2024-09-22T03:10:36.731332+0000","last_clean":"2024-09-22T03:10:36.731332+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:10:36.731332+0000","last_undegraded":"2024-09-22T03:10:36.731332+0000","last_fullsized":"2024-09-22T03:10:36.731332+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'711","reported_seq":724,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.181502+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:10:36.181502+0000","last_peered":"2024-09-22T03:10:36.181502+0000","last_clean":"2024-09-22T03:10:36.181502+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:10:36.181502+0000","last_undegraded":"2024-09-22T03:10:36.181502+0000","last_fullsized":"2024-09-22T03:10:36.181502+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"42'815","reported_seq":828,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.357598+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:10:36.357598+0000","last_peered":"2024-09-22T03:10:36.357598+0000","last_clean":"2024-09-22T03:10:36.357598+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:10:36.357598+0000","last_undegraded":"2024-09-22T03:10:36.357598+0000","last_fullsized":"2024-09-22T03:10:36.357598+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"42'943","reported_seq":956,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.611375+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:10:36.611375+0000","last_peered":"2024-09-22T03:10:36.611375+0000","last_clean":"2024-09-22T03:10:36.611375+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:10:36.611375+0000","last_undegraded":"2024-09-22T03:10:36.611375+0000","last_fullsized":"2024-09-22T03:10:36.611375+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"45'975","reported_seq":997,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-22T03:10:40.569224+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:10:40.569224+0000","last_peered":"2024-09-22T03:10:40.569224+0000","last_clean":"2024-09-22T03:10:40.569224+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:10:40.569224+0000","last_undegraded":"2024-09-22T03:10:40.569224+0000","last_fullsized":"2024-09-22T03:10:40.569224+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'944","reported_seq":965,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-22T03:10:40.468681+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:10:40.468681+0000","last_peered":"2024-09-22T03:10:40.468681+0000","last_clean":"2024-09-22T03:10:40.468681+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:10:40.468681+0000","last_undegraded":"2024-09-22T03:10:40.468681+0000","last_fullsized":"2024-09-22T03:10:40.468681+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.448786+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:09:54.448786+0000","last_peered":"2024-09-22T03:09:54.448786+0000","last_clean":"2024-09-22T03:09:54.448786+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:09:54.448786+0000","last_undegraded":"2024-09-22T03:09:54.448786+0000","last_fullsized":"2024-09-22T03:09:54.448786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"42'847","reported_seq":860,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.666698+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:10:36.666698+0000","last_peered":"2024-09-22T03:10:36.666698+0000","last_clean":"2024-09-22T03:10:36.666698+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:10:36.666698+0000","last_undegraded":"2024-09-22T03:10:36.666698+0000","last_fullsized":"2024-09-22T03:10:36.666698+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-22T03:10:40.460825+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:10:40.460825+0000","last_peered":"2024-09-22T03:10:40.460825+0000","last_clean":"2024-09-22T03:10:40.460825+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:10:40.460825+0000","last_undegraded":"2024-09-22T03:10:40.460825+0000","last_fullsized":"2024-09-22T03:10:40.460825+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"42'927","reported_seq":940,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.681183+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:10:36.681183+0000","last_peered":"2024-09-22T03:10:36.681183+0000","last_clean":"2024-09-22T03:10:36.681183+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:10:36.681183+0000","last_undegraded":"2024-09-22T03:10:36.681183+0000","last_fullsized":"2024-09-22T03:10:36.681183+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":102,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.451320+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:09:54.451320+0000","last_peered":"2024-09-22T03:09:54.451320+0000","last_clean":"2024-09-22T03:09:54.451320+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:09:54.451320+0000","last_undegraded":"2024-09-22T03:09:54.451320+0000","last_fullsized":"2024-09-22T03:09:54.451320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"42'759","reported_seq":772,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:35.698223+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:10:35.698223+0000","last_peered":"2024-09-22T03:10:35.698223+0000","last_clean":"2024-09-22T03:10:35.698223+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:10:35.698223+0000","last_undegraded":"2024-09-22T03:10:35.698223+0000","last_fullsized":"2024-09-22T03:10:35.698223+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":101,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453949+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:09:54.453949+0000","last_peered":"2024-09-22T03:09:54.453949+0000","last_clean":"2024-09-22T03:09:54.453949+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:09:54.453949+0000","last_undegraded":"2024-09-22T03:09:54.453949+0000","last_fullsized":"2024-09-22T03:09:54.453949+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":235,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-22T03:10:40.465518+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:10:40.465518+0000","last_peered":"2024-09-22T03:10:40.465518+0000","last_clean":"2024-09-22T03:10:40.465518+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:10:40.465518+0000","last_undegraded":"2024-09-22T03:10:40.465518+0000","last_fullsized":"2024-09-22T03:10:40.465518+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"45'975","reported_seq":997,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-22T03:10:40.601517+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:10:40.601517+0000","last_peered":"2024-09-22T03:10:40.601517+0000","last_clean":"2024-09-22T03:10:40.601517+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:10:40.601517+0000","last_undegraded":"2024-09-22T03:10:40.601517+0000","last_fullsized":"2024-09-22T03:10:40.601517+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.454268+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:09:54.454268+0000","last_peered":"2024-09-22T03:09:54.454268+0000","last_clean":"2024-09-22T03:09:54.454268+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:09:54.454268+0000","last_undegraded":"2024-09-22T03:09:54.454268+0000","last_fullsized":"2024-09-22T03:09:54.454268+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"42'880","reported_seq":893,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.503506+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:10:36.503506+0000","last_peered":"2024-09-22T03:10:36.503506+0000","last_clean":"2024-09-22T03:10:36.503506+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:10:36.503506+0000","last_undegraded":"2024-09-22T03:10:36.503506+0000","last_fullsized":"2024-09-22T03:10:36.503506+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7217152,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":881,"num_write_kb":7048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.456175+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:09:54.456175+0000","last_peered":"2024-09-22T03:09:54.456175+0000","last_clean":"2024-09-22T03:09:54.456175+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:09:54.456175+0000","last_undegraded":"2024-09-22T03:09:54.456175+0000","last_fullsized":"2024-09-22T03:09:54.456175+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"42'791","reported_seq":804,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.068992+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:10:36.068992+0000","last_peered":"2024-09-22T03:10:36.068992+0000","last_clean":"2024-09-22T03:10:36.068992+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:10:36.068992+0000","last_undegraded":"2024-09-22T03:10:36.068992+0000","last_fullsized":"2024-09-22T03:10:36.068992+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.459126+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:09:54.459126+0000","last_peered":"2024-09-22T03:09:54.459126+0000","last_clean":"2024-09-22T03:09:54.459126+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:09:54.459126+0000","last_undegraded":"2024-09-22T03:09:54.459126+0000","last_fullsized":"2024-09-22T03:09:54.459126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"42'751","reported_seq":764,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.634958+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:10:36.634958+0000","last_peered":"2024-09-22T03:10:36.634958+0000","last_clean":"2024-09-22T03:10:36.634958+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:10:36.634958+0000","last_undegraded":"2024-09-22T03:10:36.634958+0000","last_fullsized":"2024-09-22T03:10:36.634958+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.457345+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:09:54.457345+0000","last_peered":"2024-09-22T03:09:54.457345+0000","last_clean":"2024-09-22T03:09:54.457345+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:09:54.457345+0000","last_undegraded":"2024-09-22T03:09:54.457345+0000","last_fullsized":"2024-09-22T03:09:54.457345+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":113319936,"num_objects":1730,"num_object_clones":0,"num_object_copies":5190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13833,"num_write_kb":110664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":171298816,"data_stored":342597632,"data_compressed":17686950,"data_compressed_allocated":171298816,"data_compressed_original":342597632,"omap_allocated":0,"internal_metadata":0},"log_size":13818,"ondisk_log_size":13818,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":163252,"kb_used_data":37860,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94208588,"statfs":{"total":96636764160,"available":96469594112,"internally_reserved":0,"allocated":38768640,"data_stored":76934689,"data_compressed":3965319,"data_compressed_allocated":38404096,"data_compressed_original":76808192,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148200,"kb_used_data":36696,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94223640,"statfs":{"total":96636764160,"available":96485007360,"internally_reserved":0,"allocated":37576704,"data_stored":75018305,"data_compressed":3865763,"data_compressed_allocated":37191680,"data_compressed_original":74874880,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165316,"kb_used_data":44084,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94206524,"statfs":{"total":96636764160,"available":96467480576,"internally_reserved":0,"allocated":45142016,"data_stored":90148929,"data_compressed":4647021,"data_compressed_allocated":44756992,"data_compressed_original":90005504,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":177664,"kb_used_data":48112,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94194176,"statfs":{"total":96636764160,"available":96454836224,"internally_reserved":0,"allocated":49266688,"data_stored":98380224,"data_compressed":5071576,"data_compressed_allocated":48869376,"data_compressed_original":98230272,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49344512,"data_stored":98689024,"data_compressed":5094914,"data_compressed_allocated":49344512,"data_compressed_original":98689024,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45285376,"data_stored":90570752,"data_compressed":4675858,"data_compressed_allocated":45285376,"data_compressed_original":90570752,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37769216,"data_stored":75538432,"data_compressed":3899676,"data_compressed_allocated":37769216,"data_compressed_original":75538432,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38899712,"data_stored":77799424,"data_compressed":4016502,"data_compressed_allocated":38899712,"data_compressed_original":77799424,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:41.928 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:42.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:42.041+0000 7fbd9522c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:42.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:42.050+0000 7fbd9522c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:42.313 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:10:42.313 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:10:42.330 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-09-22T03:10:41.441839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":113910323,"num_objects":1734,"num_object_clones":0,"num_object_copies":5202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":13972,"num_write_kb":112560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13918,"ondisk_log_size":13918,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":654432,"kb_used_data":166752,"kb_used_omap":0,"kb_used_meta":487616,"kb_avail":376832928,"statfs":{"total":386547056640,"available":385876918272,"internally_reserved":0,"allocated":170754048,"data_stored":340482147,"data_compressed":17549679,"data_compressed_allocated":169222144,"data_compressed_original":339918848,"omap_allocated":0,"internal_metadata":499318784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5087232,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":621,"num_write_kb":4968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.684423"},"pg_stats":[{"pgid":"6.f","version":"42'879","reported_seq":892,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:35.374302+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:10:35.374302+0000","last_peered":"2024-09-22T03:10:35.374302+0000","last_clean":"2024-09-22T03:10:35.374302+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:10:35.374302+0000","last_undegraded":"2024-09-22T03:10:35.374302+0000","last_fullsized":"2024-09-22T03:10:35.374302+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"42'791","reported_seq":804,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.718541+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:10:36.718541+0000","last_peered":"2024-09-22T03:10:36.718541+0000","last_clean":"2024-09-22T03:10:36.718541+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:10:36.718541+0000","last_undegraded":"2024-09-22T03:10:36.718541+0000","last_fullsized":"2024-09-22T03:10:36.718541+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"42'1023","reported_seq":1036,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.538545+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:10:36.538545+0000","last_peered":"2024-09-22T03:10:36.538545+0000","last_clean":"2024-09-22T03:10:36.538545+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:10:36.538545+0000","last_undegraded":"2024-09-22T03:10:36.538545+0000","last_fullsized":"2024-09-22T03:10:36.538545+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"42'807","reported_seq":820,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.731332+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:10:36.731332+0000","last_peered":"2024-09-22T03:10:36.731332+0000","last_clean":"2024-09-22T03:10:36.731332+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:10:36.731332+0000","last_undegraded":"2024-09-22T03:10:36.731332+0000","last_fullsized":"2024-09-22T03:10:36.731332+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'711","reported_seq":724,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.181502+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:10:36.181502+0000","last_peered":"2024-09-22T03:10:36.181502+0000","last_clean":"2024-09-22T03:10:36.181502+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:10:36.181502+0000","last_undegraded":"2024-09-22T03:10:36.181502+0000","last_fullsized":"2024-09-22T03:10:36.181502+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"42'815","reported_seq":828,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.357598+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:10:36.357598+0000","last_peered":"2024-09-22T03:10:36.357598+0000","last_clean":"2024-09-22T03:10:36.357598+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:10:36.357598+0000","last_undegraded":"2024-09-22T03:10:36.357598+0000","last_fullsized":"2024-09-22T03:10:36.357598+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"42'943","reported_seq":956,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.611375+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:10:36.611375+0000","last_peered":"2024-09-22T03:10:36.611375+0000","last_clean":"2024-09-22T03:10:36.611375+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:10:36.611375+0000","last_undegraded":"2024-09-22T03:10:36.611375+0000","last_fullsized":"2024-09-22T03:10:36.611375+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"45'975","reported_seq":997,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-22T03:10:40.569224+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:10:40.569224+0000","last_peered":"2024-09-22T03:10:40.569224+0000","last_clean":"2024-09-22T03:10:40.569224+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:10:40.569224+0000","last_undegraded":"2024-09-22T03:10:40.569224+0000","last_fullsized":"2024-09-22T03:10:40.569224+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'944","reported_seq":965,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-22T03:10:40.468681+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:10:40.468681+0000","last_peered":"2024-09-22T03:10:40.468681+0000","last_clean":"2024-09-22T03:10:40.468681+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:10:40.468681+0000","last_undegraded":"2024-09-22T03:10:40.468681+0000","last_fullsized":"2024-09-22T03:10:40.468681+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.448786+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:09:54.448786+0000","last_peered":"2024-09-22T03:09:54.448786+0000","last_clean":"2024-09-22T03:09:54.448786+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:09:54.448786+0000","last_undegraded":"2024-09-22T03:09:54.448786+0000","last_fullsized":"2024-09-22T03:09:54.448786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"42'847","reported_seq":860,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.666698+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:10:36.666698+0000","last_peered":"2024-09-22T03:10:36.666698+0000","last_clean":"2024-09-22T03:10:36.666698+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:10:36.666698+0000","last_undegraded":"2024-09-22T03:10:36.666698+0000","last_fullsized":"2024-09-22T03:10:36.666698+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-22T03:10:40.460825+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:10:40.460825+0000","last_peered":"2024-09-22T03:10:40.460825+0000","last_clean":"2024-09-22T03:10:40.460825+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:10:40.460825+0000","last_undegraded":"2024-09-22T03:10:40.460825+0000","last_fullsized":"2024-09-22T03:10:40.460825+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"42'927","reported_seq":940,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.681183+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:10:36.681183+0000","last_peered":"2024-09-22T03:10:36.681183+0000","last_clean":"2024-09-22T03:10:36.681183+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:10:36.681183+0000","last_undegraded":"2024-09-22T03:10:36.681183+0000","last_fullsized":"2024-09-22T03:10:36.681183+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":102,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.451320+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:09:54.451320+0000","last_peered":"2024-09-22T03:09:54.451320+0000","last_clean":"2024-09-22T03:09:54.451320+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:09:54.451320+0000","last_undegraded":"2024-09-22T03:09:54.451320+0000","last_fullsized":"2024-09-22T03:09:54.451320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"42'759","reported_seq":772,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:35.698223+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:10:35.698223+0000","last_peered":"2024-09-22T03:10:35.698223+0000","last_clean":"2024-09-22T03:10:35.698223+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:10:35.698223+0000","last_undegraded":"2024-09-22T03:10:35.698223+0000","last_fullsized":"2024-09-22T03:10:35.698223+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":101,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.453949+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:09:54.453949+0000","last_peered":"2024-09-22T03:09:54.453949+0000","last_clean":"2024-09-22T03:09:54.453949+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:09:54.453949+0000","last_undegraded":"2024-09-22T03:09:54.453949+0000","last_fullsized":"2024-09-22T03:09:54.453949+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":235,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-22T03:10:40.465518+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:10:40.465518+0000","last_peered":"2024-09-22T03:10:40.465518+0000","last_clean":"2024-09-22T03:10:40.465518+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:10:40.465518+0000","last_undegraded":"2024-09-22T03:10:40.465518+0000","last_fullsized":"2024-09-22T03:10:40.465518+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"45'975","reported_seq":997,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-22T03:10:40.601517+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:10:40.601517+0000","last_peered":"2024-09-22T03:10:40.601517+0000","last_clean":"2024-09-22T03:10:40.601517+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:10:40.601517+0000","last_undegraded":"2024-09-22T03:10:40.601517+0000","last_fullsized":"2024-09-22T03:10:40.601517+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.454268+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:09:54.454268+0000","last_peered":"2024-09-22T03:09:54.454268+0000","last_clean":"2024-09-22T03:09:54.454268+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:09:54.454268+0000","last_undegraded":"2024-09-22T03:09:54.454268+0000","last_fullsized":"2024-09-22T03:09:54.454268+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"42'880","reported_seq":893,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.503506+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:10:36.503506+0000","last_peered":"2024-09-22T03:10:36.503506+0000","last_clean":"2024-09-22T03:10:36.503506+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:10:36.503506+0000","last_undegraded":"2024-09-22T03:10:36.503506+0000","last_fullsized":"2024-09-22T03:10:36.503506+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7217152,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":881,"num_write_kb":7048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.456175+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:09:54.456175+0000","last_peered":"2024-09-22T03:09:54.456175+0000","last_clean":"2024-09-22T03:09:54.456175+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:09:54.456175+0000","last_undegraded":"2024-09-22T03:09:54.456175+0000","last_fullsized":"2024-09-22T03:09:54.456175+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"42'791","reported_seq":804,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.068992+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:10:36.068992+0000","last_peered":"2024-09-22T03:10:36.068992+0000","last_clean":"2024-09-22T03:10:36.068992+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:10:36.068992+0000","last_undegraded":"2024-09-22T03:10:36.068992+0000","last_fullsized":"2024-09-22T03:10:36.068992+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.459126+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:09:54.459126+0000","last_peered":"2024-09-22T03:09:54.459126+0000","last_clean":"2024-09-22T03:09:54.459126+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:09:54.459126+0000","last_undegraded":"2024-09-22T03:09:54.459126+0000","last_fullsized":"2024-09-22T03:09:54.459126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"42'751","reported_seq":764,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:10:36.634958+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:10:36.634958+0000","last_peered":"2024-09-22T03:10:36.634958+0000","last_clean":"2024-09-22T03:10:36.634958+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:10:36.634958+0000","last_undegraded":"2024-09-22T03:10:36.634958+0000","last_fullsized":"2024-09-22T03:10:36.634958+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-22T03:09:54.457345+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:09:54.457345+0000","last_peered":"2024-09-22T03:09:54.457345+0000","last_clean":"2024-09-22T03:09:54.457345+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:09:54.457345+0000","last_undegraded":"2024-09-22T03:09:54.457345+0000","last_fullsized":"2024-09-22T03:09:54.457345+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":113319936,"num_objects":1730,"num_object_clones":0,"num_object_copies":5190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13833,"num_write_kb":110664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":171298816,"data_stored":342597632,"data_compressed":17686950,"data_compressed_allocated":171298816,"data_compressed_original":342597632,"omap_allocated":0,"internal_metadata":0},"log_size":13818,"ondisk_log_size":13818,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":163252,"kb_used_data":37860,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94208588,"statfs":{"total":96636764160,"available":96469594112,"internally_reserved":0,"allocated":38768640,"data_stored":76934689,"data_compressed":3965319,"data_compressed_allocated":38404096,"data_compressed_original":76808192,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148200,"kb_used_data":36696,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94223640,"statfs":{"total":96636764160,"available":96485007360,"internally_reserved":0,"allocated":37576704,"data_stored":75018305,"data_compressed":3865763,"data_compressed_allocated":37191680,"data_compressed_original":74874880,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165316,"kb_used_data":44084,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94206524,"statfs":{"total":96636764160,"available":96467480576,"internally_reserved":0,"allocated":45142016,"data_stored":90148929,"data_compressed":4647021,"data_compressed_allocated":44756992,"data_compressed_original":90005504,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":177664,"kb_used_data":48112,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94194176,"statfs":{"total":96636764160,"available":96454836224,"internally_reserved":0,"allocated":49266688,"data_stored":98380224,"data_compressed":5071576,"data_compressed_allocated":48869376,"data_compressed_original":98230272,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49344512,"data_stored":98689024,"data_compressed":5094914,"data_compressed_allocated":49344512,"data_compressed_original":98689024,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45285376,"data_stored":90570752,"data_compressed":4675858,"data_compressed_allocated":45285376,"data_compressed_original":90570752,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37769216,"data_stored":75538432,"data_compressed":3899676,"data_compressed_allocated":37769216,"data_compressed_original":75538432,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38899712,"data_stored":77799424,"data_compressed":4016502,"data_compressed_allocated":38899712,"data_compressed_original":77799424,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:42.332 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:10:42.332 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:10:42.332 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:10:42.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:10:42.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:42.458+0000 7f2ee5797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:42.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:42.469+0000 7f2ee5797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:42.517 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:42.517 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:42.517 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:42.517 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:42.517 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:42.518 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:42.518 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:42.518 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:42.518 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:42.518 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:42.518 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:42.518 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:42.520 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:42.521 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:42.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:10:42.529 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 48 16 15208 15192 2.47246 2.05469 0.0787957 0.050525 2024-09-22T03:10:42.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:42.651+0000 7f018e997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:42.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:42.660+0000 7f018e997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:42.718 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:42.718 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:42.718 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:42.718 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:42.718 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:42.718 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:42.719 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:42.719 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:42.719 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:42.719 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:42.719 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:42.719 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:42.722 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:42.722 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:42.722 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:10:42.810 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:42.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:42.887+0000 7f6a7224f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:42.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:42.903+0000 7f6a7224f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:42.939 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:42.939 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:42.939 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:42.939 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:42.939 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:42.939 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:42.939 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:42.939 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:42.939 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:42.939 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:42.939 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:42.940 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:42.941 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:42.942 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:42.942 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:10:42.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:42.939+0000 7f5346997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:42.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:42.944+0000 7f5346997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:43.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:43.086+0000 7f3ba2397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:43.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:43.095+0000 7f3ba2397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:43.134 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:43.134 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:43.134 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:43.134 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:43.134 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:43.135 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:43.135 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:43.135 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:43.135 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:43.135 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:43.135 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:43.135 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:43.138 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:43.138 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:43.529 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 49 16 15495 15479 2.46776 2.24219 0.0766245 0.0506107 2024-09-22T03:10:44.529 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 50 16 15764 15748 2.46043 2.10156 0.056763 0.0507553 2024-09-22T03:10:45.130 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:45.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:45.248+0000 7f670946c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:45.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:45.254+0000 7f670946c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:45.529 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 51 16 16039 16023 2.45431 2.14844 0.0609928 0.050881 2024-09-22T03:10:46.529 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 52 16 16325 16309 2.45008 2.23438 0.067167 0.0509792 2024-09-22T03:10:47.417 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:47.529 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 53 16 16593 16577 2.44335 2.09375 0.0835599 0.0511054 2024-09-22T03:10:47.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:47.530+0000 7f8c0b597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:47.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:47.535+0000 7f8c0b597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:48.139 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:10:48.139 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:10:48.139 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:48.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:48.268+0000 7fbf63c4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:48.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:48.277+0000 7fbf63c4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:48.529 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 54 16 16868 16852 2.43789 2.14844 0.0318962 0.0512357 2024-09-22T03:10:48.583 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:10:48.585 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:10:48.606 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-22T03:10:46.759158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":134136371,"num_objects":2043,"num_object_clones":0,"num_object_copies":6129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":16441,"num_write_kb":132312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16386,"ondisk_log_size":16386,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":692444,"kb_used_data":195036,"kb_used_omap":0,"kb_used_meta":497344,"kb_avail":376794916,"statfs":{"total":386547056640,"available":385837993984,"internally_reserved":0,"allocated":199716864,"data_stored":398224225,"data_compressed":20528868,"data_compressed_allocated":198070272,"data_compressed_original":397615104,"omap_allocated":0,"internal_metadata":509280256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22175744,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2707,"num_write_kb":21656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.323472"},"pg_stats":[{"pgid":"6.f","version":"46'1039","reported_seq":1064,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.633221+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:10:46.633221+0000","last_peered":"2024-09-22T03:10:46.633221+0000","last_clean":"2024-09-22T03:10:46.633221+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:10:46.633221+0000","last_undegraded":"2024-09-22T03:10:46.633221+0000","last_fullsized":"2024-09-22T03:10:46.633221+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"46'927","reported_seq":952,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:45.116777+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:10:45.116777+0000","last_peered":"2024-09-22T03:10:45.116777+0000","last_clean":"2024-09-22T03:10:45.116777+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:10:45.116777+0000","last_undegraded":"2024-09-22T03:10:45.116777+0000","last_fullsized":"2024-09-22T03:10:45.116777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"46'1191","reported_seq":1216,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.333544+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:10:46.333544+0000","last_peered":"2024-09-22T03:10:46.333544+0000","last_clean":"2024-09-22T03:10:46.333544+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:10:46.333544+0000","last_undegraded":"2024-09-22T03:10:46.333544+0000","last_fullsized":"2024-09-22T03:10:46.333544+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"46'951","reported_seq":976,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.315916+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:10:46.315916+0000","last_peered":"2024-09-22T03:10:46.315916+0000","last_clean":"2024-09-22T03:10:46.315916+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:10:46.315916+0000","last_undegraded":"2024-09-22T03:10:46.315916+0000","last_fullsized":"2024-09-22T03:10:46.315916+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":951,"log_dups_size":0,"ondisk_log_size":951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'895","reported_seq":920,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.681462+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:10:46.681462+0000","last_peered":"2024-09-22T03:10:46.681462+0000","last_clean":"2024-09-22T03:10:46.681462+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:10:46.681462+0000","last_undegraded":"2024-09-22T03:10:46.681462+0000","last_fullsized":"2024-09-22T03:10:46.681462+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"46'951","reported_seq":976,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.140614+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:10:46.140614+0000","last_peered":"2024-09-22T03:10:46.140614+0000","last_clean":"2024-09-22T03:10:46.140614+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:10:46.140614+0000","last_undegraded":"2024-09-22T03:10:46.140614+0000","last_fullsized":"2024-09-22T03:10:46.140614+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":951,"log_dups_size":0,"ondisk_log_size":951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"46'1111","reported_seq":1136,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.730912+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:10:46.730912+0000","last_peered":"2024-09-22T03:10:46.730912+0000","last_clean":"2024-09-22T03:10:46.730912+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:10:46.730912+0000","last_undegraded":"2024-09-22T03:10:46.730912+0000","last_fullsized":"2024-09-22T03:10:46.730912+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1111,"log_dups_size":0,"ondisk_log_size":1111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"46'1064","reported_seq":1089,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:45.378090+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:10:45.378090+0000","last_peered":"2024-09-22T03:10:45.378090+0000","last_clean":"2024-09-22T03:10:45.378090+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:10:45.378090+0000","last_undegraded":"2024-09-22T03:10:45.378090+0000","last_fullsized":"2024-09-22T03:10:45.378090+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1064,"log_dups_size":0,"ondisk_log_size":1064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8724480,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'999","reported_seq":1024,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:45.595948+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:10:45.595948+0000","last_peered":"2024-09-22T03:10:45.595948+0000","last_clean":"2024-09-22T03:10:45.595948+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:10:45.595948+0000","last_undegraded":"2024-09-22T03:10:45.595948+0000","last_fullsized":"2024-09-22T03:10:45.595948+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1000,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.454682+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:10:41.454682+0000","last_peered":"2024-09-22T03:10:41.454682+0000","last_clean":"2024-09-22T03:10:41.454682+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:10:41.454682+0000","last_undegraded":"2024-09-22T03:10:41.454682+0000","last_fullsized":"2024-09-22T03:10:41.454682+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"46'1079","reported_seq":1104,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.544569+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:10:46.544569+0000","last_peered":"2024-09-22T03:10:46.544569+0000","last_clean":"2024-09-22T03:10:46.544569+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:10:46.544569+0000","last_undegraded":"2024-09-22T03:10:46.544569+0000","last_fullsized":"2024-09-22T03:10:46.544569+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.467690+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:10:41.467690+0000","last_peered":"2024-09-22T03:10:41.467690+0000","last_clean":"2024-09-22T03:10:41.467690+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:10:41.467690+0000","last_undegraded":"2024-09-22T03:10:41.467690+0000","last_fullsized":"2024-09-22T03:10:41.467690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"46'1063","reported_seq":1088,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.084514+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:10:46.084514+0000","last_peered":"2024-09-22T03:10:46.084514+0000","last_clean":"2024-09-22T03:10:46.084514+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:10:46.084514+0000","last_undegraded":"2024-09-22T03:10:46.084514+0000","last_fullsized":"2024-09-22T03:10:46.084514+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":114,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.454425+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:10:41.454425+0000","last_peered":"2024-09-22T03:10:41.454425+0000","last_clean":"2024-09-22T03:10:41.454425+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:10:41.454425+0000","last_undegraded":"2024-09-22T03:10:41.454425+0000","last_fullsized":"2024-09-22T03:10:41.454425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"46'943","reported_seq":968,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.385521+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:10:46.385521+0000","last_peered":"2024-09-22T03:10:46.385521+0000","last_clean":"2024-09-22T03:10:46.385521+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:10:46.385521+0000","last_undegraded":"2024-09-22T03:10:46.385521+0000","last_fullsized":"2024-09-22T03:10:46.385521+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":113,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.457004+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:10:41.457004+0000","last_peered":"2024-09-22T03:10:41.457004+0000","last_clean":"2024-09-22T03:10:41.457004+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:10:41.457004+0000","last_undegraded":"2024-09-22T03:10:41.457004+0000","last_fullsized":"2024-09-22T03:10:41.457004+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":238,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.467562+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:10:41.467562+0000","last_peered":"2024-09-22T03:10:41.467562+0000","last_clean":"2024-09-22T03:10:41.467562+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:10:41.467562+0000","last_undegraded":"2024-09-22T03:10:41.467562+0000","last_fullsized":"2024-09-22T03:10:41.467562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"46'1063","reported_seq":1088,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:44.714848+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:10:44.714848+0000","last_peered":"2024-09-22T03:10:44.714848+0000","last_clean":"2024-09-22T03:10:44.714848+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:10:44.714848+0000","last_undegraded":"2024-09-22T03:10:44.714848+0000","last_fullsized":"2024-09-22T03:10:44.714848+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.478196+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:10:41.478196+0000","last_peered":"2024-09-22T03:10:41.478196+0000","last_clean":"2024-09-22T03:10:41.478196+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:10:41.478196+0000","last_undegraded":"2024-09-22T03:10:41.478196+0000","last_fullsized":"2024-09-22T03:10:41.478196+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"46'1087","reported_seq":1112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.651888+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:10:46.651888+0000","last_peered":"2024-09-22T03:10:46.651888+0000","last_clean":"2024-09-22T03:10:46.651888+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:10:46.651888+0000","last_undegraded":"2024-09-22T03:10:46.651888+0000","last_fullsized":"2024-09-22T03:10:46.651888+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1087,"log_dups_size":0,"ondisk_log_size":1087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912896,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1088,"num_write_kb":8704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.460741+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:10:41.460741+0000","last_peered":"2024-09-22T03:10:41.460741+0000","last_clean":"2024-09-22T03:10:41.460741+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:10:41.460741+0000","last_undegraded":"2024-09-22T03:10:41.460741+0000","last_fullsized":"2024-09-22T03:10:41.460741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"46'991","reported_seq":1016,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.438189+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:10:46.438189+0000","last_peered":"2024-09-22T03:10:46.438189+0000","last_clean":"2024-09-22T03:10:46.438189+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:10:46.438189+0000","last_undegraded":"2024-09-22T03:10:46.438189+0000","last_fullsized":"2024-09-22T03:10:46.438189+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.482433+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:10:41.482433+0000","last_peered":"2024-09-22T03:10:41.482433+0000","last_clean":"2024-09-22T03:10:41.482433+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:10:41.482433+0000","last_undegraded":"2024-09-22T03:10:41.482433+0000","last_fullsized":"2024-09-22T03:10:41.482433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"46'932","reported_seq":957,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:46.732776+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:10:46.732776+0000","last_peered":"2024-09-22T03:10:46.732776+0000","last_clean":"2024-09-22T03:10:46.732776+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:10:46.732776+0000","last_undegraded":"2024-09-22T03:10:46.732776+0000","last_fullsized":"2024-09-22T03:10:46.732776+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":932,"log_dups_size":0,"ondisk_log_size":932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7643136,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":933,"num_write_kb":7464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.481678+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:10:41.481678+0000","last_peered":"2024-09-22T03:10:41.481678+0000","last_clean":"2024-09-22T03:10:41.481678+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:10:41.481678+0000","last_undegraded":"2024-09-22T03:10:41.481678+0000","last_fullsized":"2024-09-22T03:10:41.481678+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":133545984,"num_objects":2039,"num_object_clones":0,"num_object_copies":6117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16302,"num_write_kb":130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200249344,"data_stored":400498688,"data_compressed":20676714,"data_compressed_allocated":200249344,"data_compressed_original":400498688,"omap_allocated":0,"internal_metadata":0},"log_size":16286,"ondisk_log_size":16286,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":174864,"kb_used_data":45312,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94196976,"statfs":{"total":96636764160,"available":96457703424,"internally_reserved":0,"allocated":46399488,"data_stored":92143941,"data_compressed":4749984,"data_compressed_allocated":46002176,"data_compressed_original":92004352,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165360,"kb_used_data":44128,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94206480,"statfs":{"total":96636764160,"available":96467435520,"internally_reserved":0,"allocated":45187072,"data_stored":90186597,"data_compressed":4648313,"data_compressed_allocated":44769280,"data_compressed_original":90030080,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":182540,"kb_used_data":52988,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94189300,"statfs":{"total":96636764160,"available":96449843200,"internally_reserved":0,"allocated":54259712,"data_stored":108331877,"data_compressed":5585235,"data_compressed_allocated":53841920,"data_compressed_original":108175360,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":169680,"kb_used_data":52608,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94202160,"statfs":{"total":96636764160,"available":96463011840,"internally_reserved":0,"allocated":53870592,"data_stored":107561810,"data_compressed":5545336,"data_compressed_allocated":53456896,"data_compressed_original":107405312,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53952512,"data_stored":107905024,"data_compressed":5570789,"data_compressed_allocated":53952512,"data_compressed_original":107905024,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":54456320,"data_stored":108912640,"data_compressed":5622955,"data_compressed_allocated":54456320,"data_compressed_original":108912640,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45236224,"data_stored":90472448,"data_compressed":4670805,"data_compressed_allocated":45236224,"data_compressed_original":90472448,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":46604288,"data_stored":93208576,"data_compressed":4812165,"data_compressed_allocated":46604288,"data_compressed_original":93208576,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:49.529 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 55 16 17148 17132 2.43333 2.1875 0.0621594 0.051329 2024-09-22T03:10:49.733 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:49.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:49.884+0000 7fad63797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:49.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:49.890+0000 7fad63797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:50.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 56 16 17406 17390 2.42587 2.01562 0.0532037 0.0514906 2024-09-22T03:10:51.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 57 16 17668 17652 2.41922 2.04688 0.065336 0.0516308 2024-09-22T03:10:52.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:52.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:52.247+0000 7f6369997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:52.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:52.253+0000 7f6369997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:52.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 58 16 17931 17915 2.41293 2.05469 0.104153 0.0517511 2024-09-22T03:10:53.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 59 16 18196 18180 2.40712 2.07031 0.036138 0.0518904 2024-09-22T03:10:53.608 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:10:53.608 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:10:53.609 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:53.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:53.745+0000 7f1403c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:53.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:53.756+0000 7f1403c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:54.043 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:10:54.044 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:10:54.062 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-09-22T03:10:52.760144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":145441331,"num_objects":2215,"num_object_clones":0,"num_object_copies":6645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":17821,"num_write_kb":143352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17766,"ondisk_log_size":17766,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":696228,"kb_used_data":211300,"kb_used_omap":0,"kb_used_meta":484864,"kb_avail":376791132,"statfs":{"total":386547056640,"available":385834119168,"internally_reserved":0,"allocated":216371200,"data_stored":431532897,"data_compressed":22248786,"data_compressed_allocated":214724608,"data_compressed_original":430923776,"omap_allocated":0,"internal_metadata":496500736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31531008,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3849,"num_write_kb":30792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.318304"},"pg_stats":[{"pgid":"6.f","version":"46'1095","reported_seq":1120,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:51.357471+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:10:51.357471+0000","last_peered":"2024-09-22T03:10:51.357471+0000","last_clean":"2024-09-22T03:10:51.357471+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:10:51.357471+0000","last_undegraded":"2024-09-22T03:10:51.357471+0000","last_fullsized":"2024-09-22T03:10:51.357471+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1096,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"46'1047","reported_seq":1072,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:51.689497+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:10:51.689497+0000","last_peered":"2024-09-22T03:10:51.689497+0000","last_clean":"2024-09-22T03:10:51.689497+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:10:51.689497+0000","last_undegraded":"2024-09-22T03:10:51.689497+0000","last_fullsized":"2024-09-22T03:10:51.689497+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"46'1287","reported_seq":1312,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:51.115415+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:10:51.115415+0000","last_peered":"2024-09-22T03:10:51.115415+0000","last_clean":"2024-09-22T03:10:51.115415+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:10:51.115415+0000","last_undegraded":"2024-09-22T03:10:51.115415+0000","last_fullsized":"2024-09-22T03:10:51.115415+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1287,"log_dups_size":0,"ondisk_log_size":1287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"46'1015","reported_seq":1040,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:50.624647+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:10:50.624647+0000","last_peered":"2024-09-22T03:10:50.624647+0000","last_clean":"2024-09-22T03:10:50.624647+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:10:50.624647+0000","last_undegraded":"2024-09-22T03:10:50.624647+0000","last_fullsized":"2024-09-22T03:10:50.624647+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1016,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'1023","reported_seq":1048,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:51.568410+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:10:51.568410+0000","last_peered":"2024-09-22T03:10:51.568410+0000","last_clean":"2024-09-22T03:10:51.568410+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:10:51.568410+0000","last_undegraded":"2024-09-22T03:10:51.568410+0000","last_fullsized":"2024-09-22T03:10:51.568410+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"46'1039","reported_seq":1064,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:51.682611+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:10:51.682611+0000","last_peered":"2024-09-22T03:10:51.682611+0000","last_clean":"2024-09-22T03:10:51.682611+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:10:51.682611+0000","last_undegraded":"2024-09-22T03:10:51.682611+0000","last_fullsized":"2024-09-22T03:10:51.682611+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"46'1153","reported_seq":1178,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:51.737825+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:10:51.737825+0000","last_peered":"2024-09-22T03:10:51.737825+0000","last_clean":"2024-09-22T03:10:51.737825+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:10:51.737825+0000","last_undegraded":"2024-09-22T03:10:51.737825+0000","last_fullsized":"2024-09-22T03:10:51.737825+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9453568,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"46'1135","reported_seq":1160,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:50.296873+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:10:50.296873+0000","last_peered":"2024-09-22T03:10:50.296873+0000","last_clean":"2024-09-22T03:10:50.296873+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:10:50.296873+0000","last_undegraded":"2024-09-22T03:10:50.296873+0000","last_fullsized":"2024-09-22T03:10:50.296873+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1135,"log_dups_size":0,"ondisk_log_size":1135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'1079","reported_seq":1104,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:50.187464+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:10:50.187464+0000","last_peered":"2024-09-22T03:10:50.187464+0000","last_clean":"2024-09-22T03:10:50.187464+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:10:50.187464+0000","last_undegraded":"2024-09-22T03:10:50.187464+0000","last_fullsized":"2024-09-22T03:10:50.187464+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.454682+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:10:41.454682+0000","last_peered":"2024-09-22T03:10:41.454682+0000","last_clean":"2024-09-22T03:10:41.454682+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:10:41.454682+0000","last_undegraded":"2024-09-22T03:10:41.454682+0000","last_fullsized":"2024-09-22T03:10:41.454682+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"46'1151","reported_seq":1176,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:51.615431+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:10:51.615431+0000","last_peered":"2024-09-22T03:10:51.615431+0000","last_clean":"2024-09-22T03:10:51.615431+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:10:51.615431+0000","last_undegraded":"2024-09-22T03:10:51.615431+0000","last_fullsized":"2024-09-22T03:10:51.615431+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.467690+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:10:41.467690+0000","last_peered":"2024-09-22T03:10:41.467690+0000","last_clean":"2024-09-22T03:10:41.467690+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:10:41.467690+0000","last_undegraded":"2024-09-22T03:10:41.467690+0000","last_fullsized":"2024-09-22T03:10:41.467690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"46'1151","reported_seq":1176,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:51.038211+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:10:51.038211+0000","last_peered":"2024-09-22T03:10:51.038211+0000","last_clean":"2024-09-22T03:10:51.038211+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:10:51.038211+0000","last_undegraded":"2024-09-22T03:10:51.038211+0000","last_fullsized":"2024-09-22T03:10:51.038211+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":114,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.454425+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:10:41.454425+0000","last_peered":"2024-09-22T03:10:41.454425+0000","last_clean":"2024-09-22T03:10:41.454425+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:10:41.454425+0000","last_undegraded":"2024-09-22T03:10:41.454425+0000","last_fullsized":"2024-09-22T03:10:41.454425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"46'1095","reported_seq":1120,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:51.714645+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:10:51.714645+0000","last_peered":"2024-09-22T03:10:51.714645+0000","last_clean":"2024-09-22T03:10:51.714645+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:10:51.714645+0000","last_undegraded":"2024-09-22T03:10:51.714645+0000","last_fullsized":"2024-09-22T03:10:51.714645+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1096,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":113,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.457004+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:10:41.457004+0000","last_peered":"2024-09-22T03:10:41.457004+0000","last_clean":"2024-09-22T03:10:41.457004+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:10:41.457004+0000","last_undegraded":"2024-09-22T03:10:41.457004+0000","last_fullsized":"2024-09-22T03:10:41.457004+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":238,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.467562+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:10:41.467562+0000","last_peered":"2024-09-22T03:10:41.467562+0000","last_clean":"2024-09-22T03:10:41.467562+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:10:41.467562+0000","last_undegraded":"2024-09-22T03:10:41.467562+0000","last_fullsized":"2024-09-22T03:10:41.467562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"46'1167","reported_seq":1192,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:50.348993+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:10:50.348993+0000","last_peered":"2024-09-22T03:10:50.348993+0000","last_clean":"2024-09-22T03:10:50.348993+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:10:50.348993+0000","last_undegraded":"2024-09-22T03:10:50.348993+0000","last_fullsized":"2024-09-22T03:10:50.348993+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1167,"log_dups_size":0,"ondisk_log_size":1167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.478196+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:10:41.478196+0000","last_peered":"2024-09-22T03:10:41.478196+0000","last_clean":"2024-09-22T03:10:41.478196+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:10:41.478196+0000","last_undegraded":"2024-09-22T03:10:41.478196+0000","last_fullsized":"2024-09-22T03:10:41.478196+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"46'1135","reported_seq":1160,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:50.455527+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:10:50.455527+0000","last_peered":"2024-09-22T03:10:50.455527+0000","last_clean":"2024-09-22T03:10:50.455527+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:10:50.455527+0000","last_undegraded":"2024-09-22T03:10:50.455527+0000","last_fullsized":"2024-09-22T03:10:50.455527+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1135,"log_dups_size":0,"ondisk_log_size":1135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.460741+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:10:41.460741+0000","last_peered":"2024-09-22T03:10:41.460741+0000","last_clean":"2024-09-22T03:10:41.460741+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:10:41.460741+0000","last_undegraded":"2024-09-22T03:10:41.460741+0000","last_fullsized":"2024-09-22T03:10:41.460741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"46'1063","reported_seq":1088,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:51.647488+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:10:51.647488+0000","last_peered":"2024-09-22T03:10:51.647488+0000","last_clean":"2024-09-22T03:10:51.647488+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:10:51.647488+0000","last_undegraded":"2024-09-22T03:10:51.647488+0000","last_fullsized":"2024-09-22T03:10:51.647488+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.482433+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:10:41.482433+0000","last_peered":"2024-09-22T03:10:41.482433+0000","last_clean":"2024-09-22T03:10:41.482433+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:10:41.482433+0000","last_undegraded":"2024-09-22T03:10:41.482433+0000","last_fullsized":"2024-09-22T03:10:41.482433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"46'1031","reported_seq":1056,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:51.189041+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:10:51.189041+0000","last_peered":"2024-09-22T03:10:51.189041+0000","last_clean":"2024-09-22T03:10:51.189041+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:10:51.189041+0000","last_undegraded":"2024-09-22T03:10:51.189041+0000","last_fullsized":"2024-09-22T03:10:51.189041+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.481678+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:10:41.481678+0000","last_peered":"2024-09-22T03:10:41.481678+0000","last_clean":"2024-09-22T03:10:41.481678+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:10:41.481678+0000","last_undegraded":"2024-09-22T03:10:41.481678+0000","last_fullsized":"2024-09-22T03:10:41.481678+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":144850944,"num_objects":2211,"num_object_clones":0,"num_object_copies":6633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17682,"num_write_kb":141456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216756224,"data_stored":433512448,"data_compressed":22381404,"data_compressed_allocated":216756224,"data_compressed_original":433512448,"omap_allocated":0,"internal_metadata":0},"log_size":17666,"ondisk_log_size":17666,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":166312,"kb_used_data":49240,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94205528,"statfs":{"total":96636764160,"available":96466460672,"internally_reserved":0,"allocated":50421760,"data_stored":100188485,"data_compressed":5165370,"data_compressed_allocated":50024448,"data_compressed_original":100048896,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":172944,"kb_used_data":47552,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94198896,"statfs":{"total":96636764160,"available":96459669504,"internally_reserved":0,"allocated":48693248,"data_stored":97198949,"data_compressed":5010401,"data_compressed_allocated":48275456,"data_compressed_original":97042432,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":178604,"kb_used_data":57372,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94193236,"statfs":{"total":96636764160,"available":96453873664,"internally_reserved":0,"allocated":58748928,"data_stored":117310309,"data_compressed":6048843,"data_compressed_allocated":58331136,"data_compressed_original":117153792,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706058,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":178368,"kb_used_data":57136,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94193472,"statfs":{"total":96636764160,"available":96454115328,"internally_reserved":0,"allocated":58507264,"data_stored":116835154,"data_compressed":6024172,"data_compressed_allocated":58093568,"data_compressed_original":116678656,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":58535936,"data_stored":117071872,"data_compressed":6044126,"data_compressed_allocated":58535936,"data_compressed_original":117071872,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58908672,"data_stored":117817344,"data_compressed":6082756,"data_compressed_allocated":58908672,"data_compressed_original":117817344,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48791552,"data_stored":97583104,"data_compressed":5037969,"data_compressed_allocated":48791552,"data_compressed_original":97583104,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50520064,"data_stored":101040128,"data_compressed":5216553,"data_compressed_allocated":50520064,"data_compressed_original":101040128,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:54.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:54.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:10:54.529365+0000 min lat: 0.0086963 max lat: 0.159834 avg lat: 0.0520007 2024-09-22T03:10:54.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:10:54.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 60 16 18468 18452 2.40242 2.125 0.0520243 0.0520007 2024-09-22T03:10:54.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:54.606+0000 7fbd21b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:54.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:54.613+0000 7fbd21b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:55.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 61 16 18728 18712 2.39633 2.03125 0.053982 0.0521276 2024-09-22T03:10:56.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 62 16 18949 18933 2.38552 1.72656 0.0250737 0.0523737 2024-09-22T03:10:56.747 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:10:56.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:56.885+0000 7f79b9357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:56.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:56.894+0000 7f79b9357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:57.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 63 16 19221 19205 2.38139 2.125 0.0688458 0.0524685 2024-09-22T03:10:58.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 64 16 19483 19467 2.37616 2.04688 0.0322428 0.0525692 2024-09-22T03:10:59.048 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:10:59.065 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:10:59.066 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:10:59.066 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:10:59.066 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:10:59.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:59.156+0000 7fa022ec3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:59.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:59.163+0000 7fa022ec3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:59.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:59.210+0000 7f8c2c917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:59.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:59.219+0000 7f8c2c917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:59.247 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:59.250 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:59.251 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:59.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:10:59.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:59.401+0000 7f1d0d757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:59.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:59.409+0000 7f1d0d757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:59.428 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:59.428 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:59.428 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:59.429 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:59.429 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:59.429 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:59.429 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:59.429 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:59.429 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:59.429 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:59.429 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:59.429 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:59.431 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:59.432 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:59.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:10:59.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 65 16 19734 19718 2.36977 1.96094 0.0457794 0.0527259 2024-09-22T03:10:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:59.553+0000 7fc4d6f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:59.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:59.562+0000 7fc4d6f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:59.582 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:59.583 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:10:59.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:10:59.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:59.702+0000 7f53e3d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:59.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:10:59.715+0000 7f53e3d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:59.781 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:10:59.781 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:10:59.782 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:10:59.782 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:10:59.782 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:10:59.782 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:10:59.782 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:10:59.782 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:10:59.782 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:10:59.782 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:10:59.782 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:10:59.782 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:10:59.784 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:10:59.785 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:00.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 66 16 19986 19970 2.36369 1.96875 0.0575195 0.0528615 2024-09-22T03:11:01.310 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:01.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:01.433+0000 7f359182c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:01.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:01.440+0000 7f359182c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:01.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 67 16 20248 20232 2.35896 2.04688 0.0482304 0.0529673 2024-09-22T03:11:02.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 68 16 20483 20467 2.35126 1.83594 0.0407433 0.0531329 2024-09-22T03:11:03.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 69 16 20738 20722 2.34606 1.99219 0.0303023 0.0532431 2024-09-22T03:11:03.642 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:03.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:03.766+0000 7f0047997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:03.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:03.771+0000 7f0047997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:04.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 70 16 20969 20953 2.33832 1.80469 0.0735705 0.0534212 2024-09-22T03:11:04.786 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:11:04.787 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:11:04.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:11:04.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:04.900+0000 7f8ceef97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:04.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:04.908+0000 7f8ceef97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:05.151 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:11:05.152 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:11:05.167 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-09-22T03:11:04.762403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":166322739,"num_objects":2534,"num_object_clones":0,"num_object_copies":7602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":20370,"num_write_kb":163744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20315,"ondisk_log_size":20315,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":739688,"kb_used_data":242276,"kb_used_omap":0,"kb_used_meta":497344,"kb_avail":376747672,"statfs":{"total":386547056640,"available":385789616128,"internally_reserved":0,"allocated":248090624,"data_stored":494971745,"data_compressed":25524498,"data_compressed_allocated":246444032,"data_compressed_original":494362624,"omap_allocated":0,"internal_metadata":509280256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20881408,"num_objects":319,"num_object_clones":0,"num_object_copies":957,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2549,"num_write_kb":20392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002258"},"pg_stats":[{"pgid":"6.f","version":"46'1215","reported_seq":1240,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:00.473233+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:11:00.473233+0000","last_peered":"2024-09-22T03:11:00.473233+0000","last_clean":"2024-09-22T03:11:00.473233+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:11:00.473233+0000","last_undegraded":"2024-09-22T03:11:00.473233+0000","last_fullsized":"2024-09-22T03:11:00.473233+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"46'1215","reported_seq":1240,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:01.308151+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:11:01.308151+0000","last_peered":"2024-09-22T03:11:01.308151+0000","last_clean":"2024-09-22T03:11:01.308151+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:11:01.308151+0000","last_undegraded":"2024-09-22T03:11:01.308151+0000","last_fullsized":"2024-09-22T03:11:01.308151+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"46'1391","reported_seq":1416,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:00.962211+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:11:00.962211+0000","last_peered":"2024-09-22T03:11:00.962211+0000","last_clean":"2024-09-22T03:11:00.962211+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:11:00.962211+0000","last_undegraded":"2024-09-22T03:11:00.962211+0000","last_fullsized":"2024-09-22T03:11:00.962211+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1392,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"46'1183","reported_seq":1208,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:01.292046+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:11:01.292046+0000","last_peered":"2024-09-22T03:11:01.292046+0000","last_clean":"2024-09-22T03:11:01.292046+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:11:01.292046+0000","last_undegraded":"2024-09-22T03:11:01.292046+0000","last_fullsized":"2024-09-22T03:11:01.292046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1183,"log_dups_size":0,"ondisk_log_size":1183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":9472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'1183","reported_seq":1208,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:01.359437+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:11:01.359437+0000","last_peered":"2024-09-22T03:11:01.359437+0000","last_clean":"2024-09-22T03:11:01.359437+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:11:01.359437+0000","last_undegraded":"2024-09-22T03:11:01.359437+0000","last_fullsized":"2024-09-22T03:11:01.359437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1183,"log_dups_size":0,"ondisk_log_size":1183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":9472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"46'1183","reported_seq":1208,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:01.431575+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:11:01.431575+0000","last_peered":"2024-09-22T03:11:01.431575+0000","last_clean":"2024-09-22T03:11:01.431575+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:11:01.431575+0000","last_undegraded":"2024-09-22T03:11:01.431575+0000","last_fullsized":"2024-09-22T03:11:01.431575+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1183,"log_dups_size":0,"ondisk_log_size":1183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":9472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"46'1295","reported_seq":1320,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:01.488436+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:11:01.488436+0000","last_peered":"2024-09-22T03:11:01.488436+0000","last_clean":"2024-09-22T03:11:01.488436+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:11:01.488436+0000","last_undegraded":"2024-09-22T03:11:01.488436+0000","last_fullsized":"2024-09-22T03:11:01.488436+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10616832,"num_objects":162,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"46'1327","reported_seq":1352,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:00.604363+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:11:00.604363+0000","last_peered":"2024-09-22T03:11:00.604363+0000","last_clean":"2024-09-22T03:11:00.604363+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:11:00.604363+0000","last_undegraded":"2024-09-22T03:11:00.604363+0000","last_fullsized":"2024-09-22T03:11:00.604363+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'1239","reported_seq":1264,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:00.555555+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:11:00.555555+0000","last_peered":"2024-09-22T03:11:00.555555+0000","last_clean":"2024-09-22T03:11:00.555555+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:11:00.555555+0000","last_undegraded":"2024-09-22T03:11:00.555555+0000","last_fullsized":"2024-09-22T03:11:00.555555+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1239,"log_dups_size":0,"ondisk_log_size":1239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.454682+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:10:41.454682+0000","last_peered":"2024-09-22T03:10:41.454682+0000","last_clean":"2024-09-22T03:10:41.454682+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:10:41.454682+0000","last_undegraded":"2024-09-22T03:10:41.454682+0000","last_fullsized":"2024-09-22T03:10:41.454682+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"46'1335","reported_seq":1360,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:00.796387+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:11:00.796387+0000","last_peered":"2024-09-22T03:11:00.796387+0000","last_clean":"2024-09-22T03:11:00.796387+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:11:00.796387+0000","last_undegraded":"2024-09-22T03:11:00.796387+0000","last_fullsized":"2024-09-22T03:11:00.796387+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1335,"log_dups_size":0,"ondisk_log_size":1335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.467690+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:10:41.467690+0000","last_peered":"2024-09-22T03:10:41.467690+0000","last_clean":"2024-09-22T03:10:41.467690+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:10:41.467690+0000","last_undegraded":"2024-09-22T03:10:41.467690+0000","last_fullsized":"2024-09-22T03:10:41.467690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"46'1343","reported_seq":1368,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:01.342436+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:11:01.342436+0000","last_peered":"2024-09-22T03:11:01.342436+0000","last_clean":"2024-09-22T03:11:01.342436+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:11:01.342436+0000","last_undegraded":"2024-09-22T03:11:01.342436+0000","last_fullsized":"2024-09-22T03:11:01.342436+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11010048,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":10752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":114,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.454425+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:10:41.454425+0000","last_peered":"2024-09-22T03:10:41.454425+0000","last_clean":"2024-09-22T03:10:41.454425+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:10:41.454425+0000","last_undegraded":"2024-09-22T03:10:41.454425+0000","last_fullsized":"2024-09-22T03:10:41.454425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"46'1320","reported_seq":1345,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:01.405440+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:11:01.405440+0000","last_peered":"2024-09-22T03:11:01.405440+0000","last_clean":"2024-09-22T03:11:01.405440+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:11:01.405440+0000","last_undegraded":"2024-09-22T03:11:01.405440+0000","last_fullsized":"2024-09-22T03:11:01.405440+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1320,"log_dups_size":0,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10821632,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1321,"num_write_kb":10568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":113,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.457004+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:10:41.457004+0000","last_peered":"2024-09-22T03:10:41.457004+0000","last_clean":"2024-09-22T03:10:41.457004+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:10:41.457004+0000","last_undegraded":"2024-09-22T03:10:41.457004+0000","last_fullsized":"2024-09-22T03:10:41.457004+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":238,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.467562+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:10:41.467562+0000","last_peered":"2024-09-22T03:10:41.467562+0000","last_clean":"2024-09-22T03:10:41.467562+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:10:41.467562+0000","last_undegraded":"2024-09-22T03:10:41.467562+0000","last_fullsized":"2024-09-22T03:10:41.467562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"46'1287","reported_seq":1312,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:00.381373+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:11:00.381373+0000","last_peered":"2024-09-22T03:11:00.381373+0000","last_clean":"2024-09-22T03:11:00.381373+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:11:00.381373+0000","last_undegraded":"2024-09-22T03:11:00.381373+0000","last_fullsized":"2024-09-22T03:11:00.381373+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1287,"log_dups_size":0,"ondisk_log_size":1287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.478196+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:10:41.478196+0000","last_peered":"2024-09-22T03:10:41.478196+0000","last_clean":"2024-09-22T03:10:41.478196+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:10:41.478196+0000","last_undegraded":"2024-09-22T03:10:41.478196+0000","last_fullsized":"2024-09-22T03:10:41.478196+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"46'1303","reported_seq":1328,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:01.570459+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:11:01.570459+0000","last_peered":"2024-09-22T03:11:01.570459+0000","last_clean":"2024-09-22T03:11:01.570459+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:11:01.570459+0000","last_undegraded":"2024-09-22T03:11:01.570459+0000","last_fullsized":"2024-09-22T03:11:01.570459+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.460741+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:10:41.460741+0000","last_peered":"2024-09-22T03:10:41.460741+0000","last_clean":"2024-09-22T03:10:41.460741+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:10:41.460741+0000","last_undegraded":"2024-09-22T03:10:41.460741+0000","last_fullsized":"2024-09-22T03:10:41.460741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"46'1237","reported_seq":1262,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:01.734979+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:11:01.734979+0000","last_peered":"2024-09-22T03:11:01.734979+0000","last_clean":"2024-09-22T03:11:01.734979+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:11:01.734979+0000","last_undegraded":"2024-09-22T03:11:01.734979+0000","last_fullsized":"2024-09-22T03:11:01.734979+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1237,"log_dups_size":0,"ondisk_log_size":1237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10141696,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":9904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.482433+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:10:41.482433+0000","last_peered":"2024-09-22T03:10:41.482433+0000","last_clean":"2024-09-22T03:10:41.482433+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:10:41.482433+0000","last_undegraded":"2024-09-22T03:10:41.482433+0000","last_fullsized":"2024-09-22T03:10:41.482433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"46'1159","reported_seq":1184,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:01.513399+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:11:01.513399+0000","last_peered":"2024-09-22T03:11:01.513399+0000","last_clean":"2024-09-22T03:11:01.513399+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:11:01.513399+0000","last_undegraded":"2024-09-22T03:11:01.513399+0000","last_fullsized":"2024-09-22T03:11:01.513399+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":9280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.481678+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:10:41.481678+0000","last_peered":"2024-09-22T03:10:41.481678+0000","last_clean":"2024-09-22T03:10:41.481678+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:10:41.481678+0000","last_undegraded":"2024-09-22T03:10:41.481678+0000","last_fullsized":"2024-09-22T03:10:41.481678+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":165732352,"num_objects":2530,"num_object_clones":0,"num_object_copies":7590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20231,"num_write_kb":161848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":248430592,"data_stored":496861184,"data_compressed":25652463,"data_compressed_allocated":248430592,"data_compressed_original":496861184,"omap_allocated":0,"internal_metadata":0},"log_size":20215,"ondisk_log_size":20215,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673364,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":181892,"kb_used_data":56500,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94189948,"statfs":{"total":96636764160,"available":96450506752,"internally_reserved":0,"allocated":57856000,"data_stored":115056965,"data_compressed":5933115,"data_compressed_allocated":57458688,"data_compressed_original":114917376,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673364,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":171712,"kb_used_data":54640,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94200128,"statfs":{"total":96636764160,"available":96460931072,"internally_reserved":0,"allocated":55951360,"data_stored":111715173,"data_compressed":5759957,"data_compressed_allocated":55533568,"data_compressed_original":111558656,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673364,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":190976,"kb_used_data":65584,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94180864,"statfs":{"total":96636764160,"available":96441204736,"internally_reserved":0,"allocated":67158016,"data_stored":134128485,"data_compressed":6917262,"data_compressed_allocated":66740224,"data_compressed_original":133971968,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":195108,"kb_used_data":65552,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94176732,"statfs":{"total":96636764160,"available":96436973568,"internally_reserved":0,"allocated":67125248,"data_stored":134071122,"data_compressed":6914164,"data_compressed_allocated":66711552,"data_compressed_original":133914624,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":67227648,"data_stored":134455296,"data_compressed":6941732,"data_compressed_allocated":67227648,"data_compressed_original":134455296,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":67198976,"data_stored":134397952,"data_compressed":6938908,"data_compressed_allocated":67198976,"data_compressed_original":134397952,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56123392,"data_stored":112246784,"data_compressed":5795139,"data_compressed_allocated":56123392,"data_compressed_original":112246784,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57880576,"data_stored":115761152,"data_compressed":5976684,"data_compressed_allocated":57880576,"data_compressed_original":115761152,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:11:05.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 71 16 21206 21190 2.33146 1.85156 0.040991 0.0535815 2024-09-22T03:11:05.884 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:06.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:06.017+0000 7f2cc5597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:06.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:06.022+0000 7f2cc5597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:06.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 72 16 21461 21445 2.32675 1.99219 0.0576496 0.0536937 2024-09-22T03:11:07.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 73 16 21729 21713 2.32355 2.09375 0.064594 0.0537416 2024-09-22T03:11:08.240 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:08.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:08.363+0000 7f67ae90e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:08.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:08.368+0000 7f67ae90e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:08.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 74 16 21945 21929 2.31496 1.6875 0.0962165 0.0539687 2024-09-22T03:11:09.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 75 16 22222 22206 2.31294 2.16406 0.0548247 0.0540163 2024-09-22T03:11:10.169 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:11:10.169 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:11:10.169 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:11:10.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:11:10.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:10.278+0000 7f6cb246c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:10.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:10.287+0000 7f6cb246c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:10.302 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:10.306 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:10.306 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:10.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:11:10.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:10.429+0000 7fdcd762c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:10.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:10.439+0000 7fdcd762c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:10.459 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:10.459 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:10.459 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:10.459 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:10.459 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:10.459 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:10.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:10.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:10.460 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:10.460 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:10.460 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:10.460 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:10.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:10.462 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:10.463 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:11:10.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 76 16 22465 22449 2.30749 1.89844 0.0411705 0.0541265 2024-09-22T03:11:10.570 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:10.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:10.593+0000 7efdd1f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:10.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:10.605+0000 7efdd1f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:10.641 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:10.641 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:10.641 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:10.642 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:10.642 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:10.642 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:10.642 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:10.642 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:10.642 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:10.642 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:10.642 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:10.642 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:10.643 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:10.643 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:10.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:11:10.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:10.694+0000 7ff831ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:10.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:10.701+0000 7ff831ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:10.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:10.822+0000 7f349c0ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:10.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:10.831+0000 7f349c0ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:10.855 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:10.855 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:10.855 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:10.855 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:10.855 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:10.855 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:10.855 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:10.856 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:10.856 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:10.856 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:10.856 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:10.856 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:10.858 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:10.859 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:11.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 77 16 22691 22675 2.30045 1.76562 0.0870648 0.0543003 2024-09-22T03:11:12.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 78 16 22946 22930 2.29649 1.99219 0.0597136 0.0544023 2024-09-22T03:11:12.925 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:13.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:13.048+0000 7f2d3ab97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:13.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:13.055+0000 7f2d3ab97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:13.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 79 16 23171 23155 2.28968 1.75781 0.0672779 0.0545628 2024-09-22T03:11:14.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:11:14.530939+0000 min lat: 0.0086963 max lat: 0.376883 avg lat: 0.0546764 2024-09-22T03:11:14.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:11:14.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 80 16 23414 23398 2.28478 1.89844 0.0223227 0.0546764 2024-09-22T03:11:15.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:15.307+0000 7f9755357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:15.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:15.313+0000 7f9755357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:15.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 81 16 23662 23646 2.28049 1.9375 0.0690399 0.0547933 2024-09-22T03:11:15.859 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:11:15.860 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:11:15.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:11:15.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:15.986+0000 7fc52b46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:15.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:15.994+0000 7fc52b46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:16.235 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:11:16.236 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:11:16.251 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-22T03:11:14.764148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":186524211,"num_objects":2842,"num_object_clones":0,"num_object_copies":8526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":22836,"num_write_kb":183472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22781,"ondisk_log_size":22781,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":748608,"kb_used_data":272000,"kb_used_omap":0,"kb_used_meta":476544,"kb_avail":376738752,"statfs":{"total":386547056640,"available":385780482048,"internally_reserved":0,"allocated":278528000,"data_stored":555846497,"data_compressed":28667808,"data_compressed_allocated":276881408,"data_compressed_original":555237376,"omap_allocated":0,"internal_metadata":487981056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20201472,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2466,"num_write_kb":19728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002167"},"pg_stats":[{"pgid":"6.f","version":"46'1367","reported_seq":1392,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:11.727626+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:11:11.727626+0000","last_peered":"2024-09-22T03:11:11.727626+0000","last_clean":"2024-09-22T03:11:11.727626+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:11:11.727626+0000","last_undegraded":"2024-09-22T03:11:11.727626+0000","last_fullsized":"2024-09-22T03:11:11.727626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1367,"log_dups_size":0,"ondisk_log_size":1367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1368,"num_write_kb":10944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"46'1335","reported_seq":1360,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:10.531111+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:11:10.531111+0000","last_peered":"2024-09-22T03:11:10.531111+0000","last_clean":"2024-09-22T03:11:10.531111+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:11:10.531111+0000","last_undegraded":"2024-09-22T03:11:10.531111+0000","last_fullsized":"2024-09-22T03:11:10.531111+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1335,"log_dups_size":0,"ondisk_log_size":1335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"46'1559","reported_seq":1584,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:11.723860+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:11:11.723860+0000","last_peered":"2024-09-22T03:11:11.723860+0000","last_clean":"2024-09-22T03:11:11.723860+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:11:11.723860+0000","last_undegraded":"2024-09-22T03:11:11.723860+0000","last_fullsized":"2024-09-22T03:11:11.723860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1559,"log_dups_size":0,"ondisk_log_size":1559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779520,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1560,"num_write_kb":12480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"46'1335","reported_seq":1360,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:11.581831+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:11:11.581831+0000","last_peered":"2024-09-22T03:11:11.581831+0000","last_clean":"2024-09-22T03:11:11.581831+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:11:11.581831+0000","last_undegraded":"2024-09-22T03:11:11.581831+0000","last_fullsized":"2024-09-22T03:11:11.581831+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1335,"log_dups_size":0,"ondisk_log_size":1335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'1392","reported_seq":1417,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:10.303724+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:11:10.303724+0000","last_peered":"2024-09-22T03:11:10.303724+0000","last_clean":"2024-09-22T03:11:10.303724+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:11:10.303724+0000","last_undegraded":"2024-09-22T03:11:10.303724+0000","last_fullsized":"2024-09-22T03:11:10.303724+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1392,"log_dups_size":0,"ondisk_log_size":1392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11411456,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1393,"num_write_kb":11144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"46'1311","reported_seq":1336,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:10.715282+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:11:10.715282+0000","last_peered":"2024-09-22T03:11:10.715282+0000","last_clean":"2024-09-22T03:11:10.715282+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:11:10.715282+0000","last_undegraded":"2024-09-22T03:11:10.715282+0000","last_fullsized":"2024-09-22T03:11:10.715282+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1311,"log_dups_size":0,"ondisk_log_size":1311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"46'1415","reported_seq":1440,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:09.618978+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:11:09.618978+0000","last_peered":"2024-09-22T03:11:09.618978+0000","last_clean":"2024-09-22T03:11:09.618978+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:11:09.618978+0000","last_undegraded":"2024-09-22T03:11:09.618978+0000","last_fullsized":"2024-09-22T03:11:09.618978+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1416,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"46'1495","reported_seq":1520,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:10.665293+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:11:10.665293+0000","last_peered":"2024-09-22T03:11:10.665293+0000","last_clean":"2024-09-22T03:11:10.665293+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:11:10.665293+0000","last_undegraded":"2024-09-22T03:11:10.665293+0000","last_fullsized":"2024-09-22T03:11:10.665293+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'1407","reported_seq":1432,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:09.414406+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:11:09.414406+0000","last_peered":"2024-09-22T03:11:09.414406+0000","last_clean":"2024-09-22T03:11:09.414406+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:11:09.414406+0000","last_undegraded":"2024-09-22T03:11:09.414406+0000","last_fullsized":"2024-09-22T03:11:09.414406+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.454682+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:10:41.454682+0000","last_peered":"2024-09-22T03:10:41.454682+0000","last_clean":"2024-09-22T03:10:41.454682+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:10:41.454682+0000","last_undegraded":"2024-09-22T03:10:41.454682+0000","last_fullsized":"2024-09-22T03:10:41.454682+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"46'1463","reported_seq":1488,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:11.530957+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:11:11.530957+0000","last_peered":"2024-09-22T03:11:11.530957+0000","last_clean":"2024-09-22T03:11:11.530957+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:11:11.530957+0000","last_undegraded":"2024-09-22T03:11:11.530957+0000","last_fullsized":"2024-09-22T03:11:11.530957+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1463,"log_dups_size":0,"ondisk_log_size":1463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1464,"num_write_kb":11712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.467690+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:10:41.467690+0000","last_peered":"2024-09-22T03:10:41.467690+0000","last_clean":"2024-09-22T03:10:41.467690+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:10:41.467690+0000","last_undegraded":"2024-09-22T03:10:41.467690+0000","last_fullsized":"2024-09-22T03:10:41.467690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"46'1479","reported_seq":1504,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:11.203938+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:11:11.203938+0000","last_peered":"2024-09-22T03:11:11.203938+0000","last_clean":"2024-09-22T03:11:11.203938+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:11:11.203938+0000","last_undegraded":"2024-09-22T03:11:11.203938+0000","last_fullsized":"2024-09-22T03:11:11.203938+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1479,"log_dups_size":0,"ondisk_log_size":1479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1480,"num_write_kb":11840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":114,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.454425+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:10:41.454425+0000","last_peered":"2024-09-22T03:10:41.454425+0000","last_clean":"2024-09-22T03:10:41.454425+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:10:41.454425+0000","last_undegraded":"2024-09-22T03:10:41.454425+0000","last_fullsized":"2024-09-22T03:10:41.454425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"46'1495","reported_seq":1520,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:11.523665+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:11:11.523665+0000","last_peered":"2024-09-22T03:11:11.523665+0000","last_clean":"2024-09-22T03:11:11.523665+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:11:11.523665+0000","last_undegraded":"2024-09-22T03:11:11.523665+0000","last_fullsized":"2024-09-22T03:11:11.523665+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":113,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.457004+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:10:41.457004+0000","last_peered":"2024-09-22T03:10:41.457004+0000","last_clean":"2024-09-22T03:10:41.457004+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:10:41.457004+0000","last_undegraded":"2024-09-22T03:10:41.457004+0000","last_fullsized":"2024-09-22T03:10:41.457004+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":238,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.467562+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:10:41.467562+0000","last_peered":"2024-09-22T03:10:41.467562+0000","last_clean":"2024-09-22T03:10:41.467562+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:10:41.467562+0000","last_undegraded":"2024-09-22T03:10:41.467562+0000","last_fullsized":"2024-09-22T03:10:41.467562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"46'1495","reported_seq":1520,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:10.038040+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:11:10.038040+0000","last_peered":"2024-09-22T03:11:10.038040+0000","last_clean":"2024-09-22T03:11:10.038040+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:11:10.038040+0000","last_undegraded":"2024-09-22T03:11:10.038040+0000","last_fullsized":"2024-09-22T03:11:10.038040+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.478196+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:10:41.478196+0000","last_peered":"2024-09-22T03:10:41.478196+0000","last_clean":"2024-09-22T03:10:41.478196+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:10:41.478196+0000","last_undegraded":"2024-09-22T03:10:41.478196+0000","last_fullsized":"2024-09-22T03:10:41.478196+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"46'1471","reported_seq":1496,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:11.577679+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:11:11.577679+0000","last_peered":"2024-09-22T03:11:11.577679+0000","last_clean":"2024-09-22T03:11:11.577679+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:11:11.577679+0000","last_undegraded":"2024-09-22T03:11:11.577679+0000","last_fullsized":"2024-09-22T03:11:11.577679+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1471,"log_dups_size":0,"ondisk_log_size":1471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.460741+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:10:41.460741+0000","last_peered":"2024-09-22T03:10:41.460741+0000","last_clean":"2024-09-22T03:10:41.460741+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:10:41.460741+0000","last_undegraded":"2024-09-22T03:10:41.460741+0000","last_fullsized":"2024-09-22T03:10:41.460741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"46'1375","reported_seq":1400,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:11.620809+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:11:11.620809+0000","last_peered":"2024-09-22T03:11:11.620809+0000","last_clean":"2024-09-22T03:11:11.620809+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:11:11.620809+0000","last_undegraded":"2024-09-22T03:11:11.620809+0000","last_fullsized":"2024-09-22T03:11:11.620809+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1376,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.482433+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:10:41.482433+0000","last_peered":"2024-09-22T03:10:41.482433+0000","last_clean":"2024-09-22T03:10:41.482433+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:10:41.482433+0000","last_undegraded":"2024-09-22T03:10:41.482433+0000","last_fullsized":"2024-09-22T03:10:41.482433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"46'1287","reported_seq":1312,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:11.142962+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:11:11.142962+0000","last_peered":"2024-09-22T03:11:11.142962+0000","last_clean":"2024-09-22T03:11:11.142962+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:11:11.142962+0000","last_undegraded":"2024-09-22T03:11:11.142962+0000","last_fullsized":"2024-09-22T03:11:11.142962+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1287,"log_dups_size":0,"ondisk_log_size":1287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.481678+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:10:41.481678+0000","last_peered":"2024-09-22T03:10:41.481678+0000","last_clean":"2024-09-22T03:10:41.481678+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:10:41.481678+0000","last_undegraded":"2024-09-22T03:10:41.481678+0000","last_fullsized":"2024-09-22T03:10:41.481678+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":185933824,"num_objects":2838,"num_object_clones":0,"num_object_copies":8514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22697,"num_write_kb":181576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278519808,"data_stored":557039616,"data_compressed":28759818,"data_compressed_allocated":278519808,"data_compressed_original":557039616,"omap_allocated":0,"internal_metadata":0},"log_size":22681,"ondisk_log_size":22681,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":180620,"kb_used_data":63548,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94191220,"statfs":{"total":96636764160,"available":96451809280,"internally_reserved":0,"allocated":65073152,"data_stored":129491269,"data_compressed":6678440,"data_compressed_allocated":64675840,"data_compressed_original":129351680,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":182488,"kb_used_data":61256,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94189352,"statfs":{"total":96636764160,"available":96449896448,"internally_reserved":0,"allocated":62726144,"data_stored":125264741,"data_compressed":6459599,"data_compressed_allocated":62308352,"data_compressed_original":125108224,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":190804,"kb_used_data":73732,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94181036,"statfs":{"total":96636764160,"available":96441380864,"internally_reserved":0,"allocated":75501568,"data_stored":150815589,"data_compressed":7778912,"data_compressed_allocated":75083776,"data_compressed_original":150659072,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":194696,"kb_used_data":73464,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94177144,"statfs":{"total":96636764160,"available":96437395456,"internally_reserved":0,"allocated":75227136,"data_stored":150274898,"data_compressed":7750857,"data_compressed_allocated":74813440,"data_compressed_original":150118400,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":75223040,"data_stored":150446080,"data_compressed":7767427,"data_compressed_allocated":75223040,"data_compressed_original":150446080,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":75661312,"data_stored":151322624,"data_compressed":7812825,"data_compressed_allocated":75661312,"data_compressed_original":151322624,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62586880,"data_stored":125173760,"data_compressed":6462633,"data_compressed_allocated":62586880,"data_compressed_original":125173760,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65048576,"data_stored":130097152,"data_compressed":6716933,"data_compressed_allocated":65048576,"data_compressed_original":130097152,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:11:16.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 82 16 23912 23896 2.2765 1.95312 0.0712539 0.0548825 2024-09-22T03:11:17.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:17.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 83 16 24162 24146 2.2726 1.95312 0.0851081 0.0549726 2024-09-22T03:11:17.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:17.658+0000 7f258a157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:17.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:17.664+0000 7f258a157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:18.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 84 16 24388 24372 2.26656 1.76562 0.0707082 0.0551212 2024-09-22T03:11:19.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 85 16 24638 24622 2.26287 1.95312 0.0905382 0.0552133 2024-09-22T03:11:19.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:20.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:20.105+0000 7f1898357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:20.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:20.113+0000 7f1898357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:20.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 86 16 24878 24862 2.25836 1.875 0.0762399 0.0553151 2024-09-22T03:11:21.253 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:11:21.253 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:11:21.254 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:11:21.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:11:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:21.402+0000 7f1c816ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:21.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:21.412+0000 7f1c816ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:21.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:21.462 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:21.463 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:11:21.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 87 16 25114 25098 2.2536 1.84375 0.0578602 0.0554324 2024-09-22T03:11:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:21.587+0000 7f91f2eba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:21.596+0000 7f91f2eba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:21.667 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:21.670 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:21.670 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:21.670 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:11:21.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:21.792+0000 7f4cb6797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:21.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:21.800+0000 7f4cb6797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:21.819 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:21.819 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:21.819 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:21.819 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:21.819 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:21.819 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:21.819 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:21.819 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:21.819 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:21.820 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:21.820 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:21.820 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:21.822 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:21.823 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:21.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:11:21.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:21.933+0000 7f56ff818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:21.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:21.943+0000 7f56ff818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:21.973 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:21.974 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:21.974 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:21.974 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:21.974 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:21.974 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:21.974 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:21.974 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:21.974 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:21.974 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:21.974 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:21.974 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:21.977 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:21.977 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:22.350 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:22.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:22.472+0000 7f61502ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:22.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:22.479+0000 7f61502ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:22.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 88 16 25337 25321 2.24778 1.74219 0.124177 0.055588 2024-09-22T03:11:23.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 89 16 25586 25570 2.24438 1.94531 0.0826198 0.0556607 2024-09-22T03:11:24.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 90 16 25836 25820 2.24114 1.95312 0.106078 0.055724 2024-09-22T03:11:24.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:24.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:24.754+0000 7fdedeed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:24.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:24.758+0000 7fdedeed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total time run: 90.0423 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total writes made: 25836 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Write size: 8192 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object size: 65536 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Bandwidth (MB/sec): 2.24166 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Bandwidth: 0.325583 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max bandwidth (MB/sec): 3.01562 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min bandwidth (MB/sec): 1.6875 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average IOPS: 286 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev IOPS: 41.6746 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max IOPS: 386 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min IOPS: 216 2024-09-22T03:11:25.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average Latency(s): 0.0557524 2024-09-22T03:11:25.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Latency(s): 0.0262446 2024-09-22T03:11:25.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max latency(s): 0.376883 2024-09-22T03:11:25.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min latency(s): 0.0086963 2024-09-22T03:11:25.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:11:26.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:26.978 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:11:26.978 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:11:26.979 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:11:26.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:11:26.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:26.975+0000 7f02f3997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:26.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:26.981+0000 7f02f3997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:27.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:27.131+0000 7f9289997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:27.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:27.147+0000 7f9289997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:27.207 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:27.207 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:27.209 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:27.209 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:27.210 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:11:27.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:27.397+0000 7fec80597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:27.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:27.410+0000 7fec80597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:27.509 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:27.510 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:27.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:11:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:27.647+0000 7fc20542c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:27.663+0000 7fc20542c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:27.687 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:27.687 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:27.687 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:27.687 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:27.687 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:27.687 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:27.688 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:27.688 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:27.688 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:27.688 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:27.688 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:27.688 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:27.694 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:27.694 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:27.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:11:27.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:27.841+0000 7f5922e58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:27.852+0000 7f5922e58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:27.896 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:27.896 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:27.897 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:27.897 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:27.897 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:27.897 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:27.897 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:27.897 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:27.898 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:27.898 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:27.898 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:27.898 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:27.900 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:27.901 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:29.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:29.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:29.492+0000 7f488e717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:29.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:29.498+0000 7f488e717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:31.713 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:31.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:31.871+0000 7fa2dd797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:31.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:31.877+0000 7fa2dd797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:32.902 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:11:32.902 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:11:32.902 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:11:32.902 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:11:33.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:33.042+0000 7f0451e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:33.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:33.056+0000 7f0451e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:33.128 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:33.128 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:33.128 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:33.129 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:33.129 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:33.129 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:33.129 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:33.129 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:33.129 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:33.129 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:33.129 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:33.129 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:33.131 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:33.132 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:33.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:11:33.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:33.268+0000 7f3197917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:33.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:33.278+0000 7f3197917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:33.318 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:33.318 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:33.318 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:33.319 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:33.319 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:33.319 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:33.319 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:33.319 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:33.319 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:33.319 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:33.319 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:33.319 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:33.324 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:33.324 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:33.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:11:33.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:33.479+0000 7f5621317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:33.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:33.494+0000 7f5621317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:33.545 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:33.545 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:33.546 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:33.546 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:33.546 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:33.546 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:33.546 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:33.546 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:33.546 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:33.546 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:33.546 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:33.546 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:33.549 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:33.549 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:33.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:11:33.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:33.685+0000 7f4794f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:33.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:33.698+0000 7f4794f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:33.750 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:33.750 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:33.751 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:33.751 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:33.751 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:33.751 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:33.751 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:33.751 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:33.751 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:33.751 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:33.751 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:33.751 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:33.753 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:33.754 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:34.065 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:34.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:34.197+0000 7f330e8fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:34.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:34.203+0000 7f330e8fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:36.199 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Removed 3230 objects 2024-09-22T03:11:36.199 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Clean up completed and total clean up time :10.6482 2024-09-22T03:11:36.535 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:36.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:36.648+0000 7f9d8d46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:36.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:36.652+0000 7f9d8d46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:38.191 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2024-09-22T03:11:38.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-09-22T03:11:38.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:38.304+0000 7fcae2e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:38.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:38.315+0000 7fcae2e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:38.723 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:38.755 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:11:38.755 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:11:38.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:11:38.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:38.826+0000 7efcb7957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:38.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:38.830+0000 7efcb7957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:38.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:38.873+0000 7fb9c66ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:38.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:38.879+0000 7fb9c66ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:11:39.064 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:11:39.075 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-09-22T03:11:38.768669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2753075,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":29174,"num_write_kb":208585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29119,"ondisk_log_size":29119,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":494764,"kb_used_data":9820,"kb_used_omap":0,"kb_used_meta":484864,"kb_avail":376992596,"statfs":{"total":386547056640,"available":386040418304,"internally_reserved":0,"allocated":10055680,"data_stored":18877353,"data_compressed":944340,"data_compressed_allocated":8396800,"data_compressed_original":18268160,"omap_allocated":0,"internal_metadata":496500736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-198180864,"num_objects":-3024,"num_object_clones":0,"num_object_copies":-9072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3364,"num_write_kb":2401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002449"},"pg_stats":[{"pgid":"6.f","version":"46'1727","reported_seq":1752,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:36.092531+0000","last_change":"2024-09-22T03:09:53.540071+0000","last_active":"2024-09-22T03:11:36.092531+0000","last_peered":"2024-09-22T03:11:36.092531+0000","last_clean":"2024-09-22T03:11:36.092531+0000","last_became_active":"2024-09-22T03:09:53.536083+0000","last_became_peered":"2024-09-22T03:09:53.536083+0000","last_unstale":"2024-09-22T03:11:36.092531+0000","last_undegraded":"2024-09-22T03:11:36.092531+0000","last_fullsized":"2024-09-22T03:11:36.092531+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1727,"log_dups_size":0,"ondisk_log_size":1727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1728,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"46'1691","reported_seq":1716,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:36.047330+0000","last_change":"2024-09-22T03:09:53.538718+0000","last_active":"2024-09-22T03:11:36.047330+0000","last_peered":"2024-09-22T03:11:36.047330+0000","last_clean":"2024-09-22T03:11:36.047330+0000","last_became_active":"2024-09-22T03:09:53.534253+0000","last_became_peered":"2024-09-22T03:09:53.534253+0000","last_unstale":"2024-09-22T03:11:36.047330+0000","last_undegraded":"2024-09-22T03:11:36.047330+0000","last_fullsized":"2024-09-22T03:11:36.047330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1692,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"46'2053","reported_seq":2079,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:36.139786+0000","last_change":"2024-09-22T03:09:53.525165+0000","last_active":"2024-09-22T03:11:36.139786+0000","last_peered":"2024-09-22T03:11:36.139786+0000","last_clean":"2024-09-22T03:11:36.139786+0000","last_became_active":"2024-09-22T03:09:53.515499+0000","last_became_peered":"2024-09-22T03:09:53.515499+0000","last_unstale":"2024-09-22T03:11:36.139786+0000","last_undegraded":"2024-09-22T03:11:36.139786+0000","last_fullsized":"2024-09-22T03:11:36.139786+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2054,"num_write_kb":14593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"46'1781","reported_seq":1806,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:36.031530+0000","last_change":"2024-09-22T03:09:53.519766+0000","last_active":"2024-09-22T03:11:36.031530+0000","last_peered":"2024-09-22T03:11:36.031530+0000","last_clean":"2024-09-22T03:11:36.031530+0000","last_became_active":"2024-09-22T03:09:53.515214+0000","last_became_peered":"2024-09-22T03:09:53.515214+0000","last_unstale":"2024-09-22T03:11:36.031530+0000","last_undegraded":"2024-09-22T03:11:36.031530+0000","last_fullsized":"2024-09-22T03:11:36.031530+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1781,"log_dups_size":0,"ondisk_log_size":1781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1782,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'1691","reported_seq":1716,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:35.834138+0000","last_change":"2024-09-22T03:09:53.519193+0000","last_active":"2024-09-22T03:11:35.834138+0000","last_peered":"2024-09-22T03:11:35.834138+0000","last_clean":"2024-09-22T03:11:35.834138+0000","last_became_active":"2024-09-22T03:09:53.506290+0000","last_became_peered":"2024-09-22T03:09:53.506290+0000","last_unstale":"2024-09-22T03:11:35.834138+0000","last_undegraded":"2024-09-22T03:11:35.834138+0000","last_fullsized":"2024-09-22T03:11:35.834138+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1692,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"46'1646","reported_seq":1671,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:36.098181+0000","last_change":"2024-09-22T03:09:53.539024+0000","last_active":"2024-09-22T03:11:36.098181+0000","last_peered":"2024-09-22T03:11:36.098181+0000","last_clean":"2024-09-22T03:11:36.098181+0000","last_became_active":"2024-09-22T03:09:53.531488+0000","last_became_peered":"2024-09-22T03:09:53.531488+0000","last_unstale":"2024-09-22T03:11:36.098181+0000","last_undegraded":"2024-09-22T03:11:36.098181+0000","last_fullsized":"2024-09-22T03:11:36.098181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1646,"log_dups_size":0,"ondisk_log_size":1646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1647,"num_write_kb":11712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"46'1831","reported_seq":1856,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:36.151820+0000","last_change":"2024-09-22T03:09:53.511543+0000","last_active":"2024-09-22T03:11:36.151820+0000","last_peered":"2024-09-22T03:11:36.151820+0000","last_clean":"2024-09-22T03:11:36.151820+0000","last_became_active":"2024-09-22T03:09:53.506075+0000","last_became_peered":"2024-09-22T03:09:53.506075+0000","last_unstale":"2024-09-22T03:11:36.151820+0000","last_undegraded":"2024-09-22T03:11:36.151820+0000","last_fullsized":"2024-09-22T03:11:36.151820+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1832,"num_write_kb":13024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"46'1896","reported_seq":1921,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:35.653518+0000","last_change":"2024-09-22T03:09:53.533928+0000","last_active":"2024-09-22T03:11:35.653518+0000","last_peered":"2024-09-22T03:11:35.653518+0000","last_clean":"2024-09-22T03:11:35.653518+0000","last_became_active":"2024-09-22T03:09:53.528633+0000","last_became_peered":"2024-09-22T03:09:53.528633+0000","last_unstale":"2024-09-22T03:11:35.653518+0000","last_undegraded":"2024-09-22T03:11:35.653518+0000","last_fullsized":"2024-09-22T03:11:35.653518+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1896,"log_dups_size":0,"ondisk_log_size":1896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1897,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'1870","reported_seq":1895,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:35.675094+0000","last_change":"2024-09-22T03:09:53.526119+0000","last_active":"2024-09-22T03:11:35.675094+0000","last_peered":"2024-09-22T03:11:35.675094+0000","last_clean":"2024-09-22T03:11:35.675094+0000","last_became_active":"2024-09-22T03:09:53.521666+0000","last_became_peered":"2024-09-22T03:09:53.521666+0000","last_unstale":"2024-09-22T03:11:35.675094+0000","last_undegraded":"2024-09-22T03:11:35.675094+0000","last_fullsized":"2024-09-22T03:11:35.675094+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1870,"log_dups_size":0,"ondisk_log_size":1870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1871,"num_write_kb":13376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.454682+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:10:41.454682+0000","last_peered":"2024-09-22T03:10:41.454682+0000","last_clean":"2024-09-22T03:10:41.454682+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:10:41.454682+0000","last_undegraded":"2024-09-22T03:10:41.454682+0000","last_fullsized":"2024-09-22T03:10:41.454682+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"46'1799","reported_seq":1824,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:35.919482+0000","last_change":"2024-09-22T03:09:53.536436+0000","last_active":"2024-09-22T03:11:35.919482+0000","last_peered":"2024-09-22T03:11:35.919482+0000","last_clean":"2024-09-22T03:11:35.919482+0000","last_became_active":"2024-09-22T03:09:53.531494+0000","last_became_peered":"2024-09-22T03:09:53.531494+0000","last_unstale":"2024-09-22T03:11:35.919482+0000","last_undegraded":"2024-09-22T03:11:35.919482+0000","last_fullsized":"2024-09-22T03:11:35.919482+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1799,"log_dups_size":0,"ondisk_log_size":1799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1800,"num_write_kb":12800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.467690+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:10:41.467690+0000","last_peered":"2024-09-22T03:10:41.467690+0000","last_clean":"2024-09-22T03:10:41.467690+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:10:41.467690+0000","last_undegraded":"2024-09-22T03:10:41.467690+0000","last_fullsized":"2024-09-22T03:10:41.467690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"46'1862","reported_seq":1887,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:36.034893+0000","last_change":"2024-09-22T03:09:53.517897+0000","last_active":"2024-09-22T03:11:36.034893+0000","last_peered":"2024-09-22T03:11:36.034893+0000","last_clean":"2024-09-22T03:11:36.034893+0000","last_became_active":"2024-09-22T03:09:53.513750+0000","last_became_peered":"2024-09-22T03:09:53.513750+0000","last_unstale":"2024-09-22T03:11:36.034893+0000","last_undegraded":"2024-09-22T03:11:36.034893+0000","last_fullsized":"2024-09-22T03:11:36.034893+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1862,"log_dups_size":0,"ondisk_log_size":1862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1863,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":114,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.454425+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:10:41.454425+0000","last_peered":"2024-09-22T03:10:41.454425+0000","last_clean":"2024-09-22T03:10:41.454425+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:10:41.454425+0000","last_undegraded":"2024-09-22T03:10:41.454425+0000","last_fullsized":"2024-09-22T03:10:41.454425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"46'1880","reported_seq":1905,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:35.861668+0000","last_change":"2024-09-22T03:09:53.502674+0000","last_active":"2024-09-22T03:11:35.861668+0000","last_peered":"2024-09-22T03:11:35.861668+0000","last_clean":"2024-09-22T03:11:35.861668+0000","last_became_active":"2024-09-22T03:09:53.495119+0000","last_became_peered":"2024-09-22T03:09:53.495119+0000","last_unstale":"2024-09-22T03:11:35.861668+0000","last_undegraded":"2024-09-22T03:11:35.861668+0000","last_fullsized":"2024-09-22T03:11:35.861668+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1880,"log_dups_size":0,"ondisk_log_size":1880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1881,"num_write_kb":13376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":113,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.457004+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:10:41.457004+0000","last_peered":"2024-09-22T03:10:41.457004+0000","last_clean":"2024-09-22T03:10:41.457004+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:10:41.457004+0000","last_undegraded":"2024-09-22T03:10:41.457004+0000","last_fullsized":"2024-09-22T03:10:41.457004+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":238,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.467562+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:10:41.467562+0000","last_peered":"2024-09-22T03:10:41.467562+0000","last_clean":"2024-09-22T03:10:41.467562+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:10:41.467562+0000","last_undegraded":"2024-09-22T03:10:41.467562+0000","last_fullsized":"2024-09-22T03:10:41.467562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"46'1940","reported_seq":1965,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:35.714181+0000","last_change":"2024-09-22T03:09:53.538062+0000","last_active":"2024-09-22T03:11:35.714181+0000","last_peered":"2024-09-22T03:11:35.714181+0000","last_clean":"2024-09-22T03:11:35.714181+0000","last_became_active":"2024-09-22T03:09:53.531375+0000","last_became_peered":"2024-09-22T03:09:53.531375+0000","last_unstale":"2024-09-22T03:11:35.714181+0000","last_undegraded":"2024-09-22T03:11:35.714181+0000","last_fullsized":"2024-09-22T03:11:35.714181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1940,"log_dups_size":0,"ondisk_log_size":1940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1941,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.478196+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:10:41.478196+0000","last_peered":"2024-09-22T03:10:41.478196+0000","last_clean":"2024-09-22T03:10:41.478196+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:10:41.478196+0000","last_undegraded":"2024-09-22T03:10:41.478196+0000","last_fullsized":"2024-09-22T03:10:41.478196+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"46'1907","reported_seq":1932,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:36.107545+0000","last_change":"2024-09-22T03:09:53.530740+0000","last_active":"2024-09-22T03:11:36.107545+0000","last_peered":"2024-09-22T03:11:36.107545+0000","last_clean":"2024-09-22T03:11:36.107545+0000","last_became_active":"2024-09-22T03:09:53.524079+0000","last_became_peered":"2024-09-22T03:09:53.524079+0000","last_unstale":"2024-09-22T03:11:36.107545+0000","last_undegraded":"2024-09-22T03:11:36.107545+0000","last_fullsized":"2024-09-22T03:11:36.107545+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1907,"log_dups_size":0,"ondisk_log_size":1907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1908,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.460741+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:10:41.460741+0000","last_peered":"2024-09-22T03:10:41.460741+0000","last_clean":"2024-09-22T03:10:41.460741+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:10:41.460741+0000","last_undegraded":"2024-09-22T03:10:41.460741+0000","last_fullsized":"2024-09-22T03:10:41.460741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"46'1700","reported_seq":1725,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:36.028441+0000","last_change":"2024-09-22T03:09:53.547121+0000","last_active":"2024-09-22T03:11:36.028441+0000","last_peered":"2024-09-22T03:11:36.028441+0000","last_clean":"2024-09-22T03:11:36.028441+0000","last_became_active":"2024-09-22T03:09:53.543899+0000","last_became_peered":"2024-09-22T03:09:53.543899+0000","last_unstale":"2024-09-22T03:11:36.028441+0000","last_undegraded":"2024-09-22T03:11:36.028441+0000","last_fullsized":"2024-09-22T03:11:36.028441+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.482433+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:10:41.482433+0000","last_peered":"2024-09-22T03:10:41.482433+0000","last_clean":"2024-09-22T03:10:41.482433+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:10:41.482433+0000","last_undegraded":"2024-09-22T03:10:41.482433+0000","last_fullsized":"2024-09-22T03:10:41.482433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"46'1745","reported_seq":1770,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:11:36.114748+0000","last_change":"2024-09-22T03:09:53.525639+0000","last_active":"2024-09-22T03:11:36.114748+0000","last_peered":"2024-09-22T03:11:36.114748+0000","last_clean":"2024-09-22T03:11:36.114748+0000","last_became_active":"2024-09-22T03:09:53.520435+0000","last_became_peered":"2024-09-22T03:09:53.520435+0000","last_unstale":"2024-09-22T03:11:36.114748+0000","last_undegraded":"2024-09-22T03:11:36.114748+0000","last_fullsized":"2024-09-22T03:11:36.114748+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:09:52.432030+0000","last_clean_scrub_stamp":"2024-09-22T03:09:52.432030+0000","objects_scrubbed":0,"log_size":1745,"log_dups_size":0,"ondisk_log_size":1745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1746,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":112,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:10:41.481678+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:10:41.481678+0000","last_peered":"2024-09-22T03:10:41.481678+0000","last_clean":"2024-09-22T03:10:41.481678+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:10:41.481678+0000","last_undegraded":"2024-09-22T03:10:41.481678+0000","last_fullsized":"2024-09-22T03:10:41.481678+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":29035,"num_write_kb":206689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3379200,"data_stored":6750232,"data_compressed":348552,"data_compressed_allocated":3375104,"data_compressed_original":6750208,"omap_allocated":0,"internal_metadata":0},"log_size":29019,"ondisk_log_size":29019,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673399,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117464,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254376,"statfs":{"total":96636764160,"available":96516481024,"internally_reserved":0,"allocated":401408,"data_stored":139613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673399,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121696,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94250144,"statfs":{"total":96636764160,"available":96512147456,"internally_reserved":0,"allocated":458752,"data_stored":729957,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673399,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121700,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94250140,"statfs":{"total":96636764160,"available":96512143360,"internally_reserved":0,"allocated":479232,"data_stored":762749,"data_compressed":31652,"data_compressed_allocated":57344,"data_compressed_original":606208,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706103,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133904,"kb_used_data":8512,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94237936,"statfs":{"total":96636764160,"available":96499646464,"internally_reserved":0,"allocated":8716288,"data_stored":17245034,"data_compressed":882728,"data_compressed_allocated":8298496,"data_compressed_original":17088512,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3379200,"data_stored":6750232,"data_compressed":348552,"data_compressed_allocated":3375104,"data_compressed_original":6750208,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:11:39.417 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_3' removed 2024-09-22T03:11:39.437 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:11:39.438 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:11:39.438 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2024-09-22T03:11:39.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 16 2024-09-22T03:11:39.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:39.558+0000 7f1f28b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:39.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:39.571+0000 7f1f28b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:40.418 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_4' created 2024-09-22T03:11:40.439 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-09-22T03:11:40.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:40.549+0000 7f16b9917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:40.561+0000 7f16b9917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:40.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:41.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:41.014+0000 7f1eabf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:41.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:41.018+0000 7f1eabf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:41.425 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-09-22T03:11:42.447 DEBUG:teuthology.orchestra.run.smithi134:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-09-22T03:11:42.450 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:11:42.450 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:11:42.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:hints = 1 2024-09-22T03:11:42.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:11:42.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object prefix: benchmark_data_smithi134_48103 2024-09-22T03:11:42.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:11:42.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:11:43.089 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:43.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:43.223+0000 7f347ab57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:43.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:43.229+0000 7f347ab57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:43.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 1 16 326 310 2.42173 2.42188 0.0463715 0.0501445 2024-09-22T03:11:44.078 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:11:44.078 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:11:44.078 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:11:44.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:11:44.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:44.201+0000 7f4eef357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:44.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:44.213+0000 7f4eef357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:44.238 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:44.238 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:44.238 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:44.242 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:44.242 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:44.243 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:11:44.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:44.379+0000 7f9ba2397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:44.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:44.387+0000 7f9ba2397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:44.407 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:44.407 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:44.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:11:44.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 2 16 692 676 2.64043 2.85938 0.0165493 0.0467806 2024-09-22T03:11:44.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:44.554+0000 7f9813b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:44.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:44.563+0000 7f9813b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:44.583 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:44.584 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:44.584 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:44.584 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:44.584 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:44.584 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:44.584 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:44.584 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:44.584 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:44.584 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:44.584 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:44.584 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:44.587 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:44.587 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:44.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:11:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:44.705+0000 7f070ce6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:44.714+0000 7f070ce6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:44.767 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:44.770 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:44.771 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:45.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:45.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 3 16 1015 999 2.60136 2.52344 0.0652781 0.0474835 2024-09-22T03:11:45.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:45.531+0000 7f77daf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:45.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:45.535+0000 7f77daf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:46.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 4 16 1351 1335 2.60721 2.625 0.0113846 0.0474754 2024-09-22T03:11:47.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 5 16 1725 1709 2.6701 2.92188 0.0374496 0.0466364 2024-09-22T03:11:47.786 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:47.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:47.902+0000 7fa4fd418640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:47.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:47.907+0000 7fa4fd418640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:48.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 6 16 2069 2053 2.67296 2.6875 0.0280554 0.046611 2024-09-22T03:11:49.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 7 16 2413 2397 2.67502 2.6875 0.0528693 0.0465029 2024-09-22T03:11:49.771 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:11:49.772 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:11:49.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:11:49.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:49.897+0000 7fc86d018640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:49.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:49.905+0000 7fc86d018640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:50.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:50.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:50.199+0000 7f665ca63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:50.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:50.207+0000 7f665ca63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:50.246 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:11:50.246 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:11:50.265 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-22T03:11:48.770505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":12231219,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":1560,"num_write_kb":13264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1505,"ondisk_log_size":1505,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":255388,"kb_used_data":15768,"kb_used_omap":0,"kb_used_meta":239552,"kb_avail":377231972,"statfs":{"total":386547056640,"available":386285539328,"internally_reserved":0,"allocated":16146432,"data_stored":30844877,"data_compressed":1556117,"data_compressed_allocated":14352384,"data_compressed_original":30179328,"omap_allocated":0,"internal_metadata":245301248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11640832,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1421,"num_write_kb":11368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001371"},"pg_stats":[{"pgid":"7.f","version":"50'119","reported_seq":132,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.347449+0000","last_change":"2024-09-22T03:11:41.549868+0000","last_active":"2024-09-22T03:11:46.347449+0000","last_peered":"2024-09-22T03:11:46.347449+0000","last_clean":"2024-09-22T03:11:46.347449+0000","last_became_active":"2024-09-22T03:11:41.545171+0000","last_became_peered":"2024-09-22T03:11:41.545171+0000","last_unstale":"2024-09-22T03:11:46.347449+0000","last_undegraded":"2024-09-22T03:11:46.347449+0000","last_fullsized":"2024-09-22T03:11:46.347449+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"50'71","reported_seq":84,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.334246+0000","last_change":"2024-09-22T03:11:41.496023+0000","last_active":"2024-09-22T03:11:46.334246+0000","last_peered":"2024-09-22T03:11:46.334246+0000","last_clean":"2024-09-22T03:11:46.334246+0000","last_became_active":"2024-09-22T03:11:41.492941+0000","last_became_peered":"2024-09-22T03:11:41.492941+0000","last_unstale":"2024-09-22T03:11:46.334246+0000","last_undegraded":"2024-09-22T03:11:46.334246+0000","last_fullsized":"2024-09-22T03:11:46.334246+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"50'47","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:45.376117+0000","last_change":"2024-09-22T03:11:41.523699+0000","last_active":"2024-09-22T03:11:45.376117+0000","last_peered":"2024-09-22T03:11:45.376117+0000","last_clean":"2024-09-22T03:11:45.376117+0000","last_became_active":"2024-09-22T03:11:41.520422+0000","last_became_peered":"2024-09-22T03:11:41.520422+0000","last_unstale":"2024-09-22T03:11:45.376117+0000","last_undegraded":"2024-09-22T03:11:45.376117+0000","last_fullsized":"2024-09-22T03:11:45.376117+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"50'135","reported_seq":148,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.595242+0000","last_change":"2024-09-22T03:11:41.513541+0000","last_active":"2024-09-22T03:11:46.595242+0000","last_peered":"2024-09-22T03:11:46.595242+0000","last_clean":"2024-09-22T03:11:46.595242+0000","last_became_active":"2024-09-22T03:11:41.509909+0000","last_became_peered":"2024-09-22T03:11:41.509909+0000","last_unstale":"2024-09-22T03:11:46.595242+0000","last_undegraded":"2024-09-22T03:11:46.595242+0000","last_fullsized":"2024-09-22T03:11:46.595242+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'71","reported_seq":84,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.697059+0000","last_change":"2024-09-22T03:11:41.518404+0000","last_active":"2024-09-22T03:11:46.697059+0000","last_peered":"2024-09-22T03:11:46.697059+0000","last_clean":"2024-09-22T03:11:46.697059+0000","last_became_active":"2024-09-22T03:11:41.513810+0000","last_became_peered":"2024-09-22T03:11:41.513810+0000","last_unstale":"2024-09-22T03:11:46.697059+0000","last_undegraded":"2024-09-22T03:11:46.697059+0000","last_fullsized":"2024-09-22T03:11:46.697059+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"50'78","reported_seq":91,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.751853+0000","last_change":"2024-09-22T03:11:41.507457+0000","last_active":"2024-09-22T03:11:46.751853+0000","last_peered":"2024-09-22T03:11:46.751853+0000","last_clean":"2024-09-22T03:11:46.751853+0000","last_became_active":"2024-09-22T03:11:41.496687+0000","last_became_peered":"2024-09-22T03:11:41.496687+0000","last_unstale":"2024-09-22T03:11:46.751853+0000","last_undegraded":"2024-09-22T03:11:46.751853+0000","last_fullsized":"2024-09-22T03:11:46.751853+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":647168,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"50'101","reported_seq":114,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.733489+0000","last_change":"2024-09-22T03:11:41.548004+0000","last_active":"2024-09-22T03:11:46.733489+0000","last_peered":"2024-09-22T03:11:46.733489+0000","last_clean":"2024-09-22T03:11:46.733489+0000","last_became_active":"2024-09-22T03:11:41.541878+0000","last_became_peered":"2024-09-22T03:11:41.541878+0000","last_unstale":"2024-09-22T03:11:46.733489+0000","last_undegraded":"2024-09-22T03:11:46.733489+0000","last_fullsized":"2024-09-22T03:11:46.733489+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":835584,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"50'47","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:45.279116+0000","last_change":"2024-09-22T03:11:41.507878+0000","last_active":"2024-09-22T03:11:45.279116+0000","last_peered":"2024-09-22T03:11:45.279116+0000","last_clean":"2024-09-22T03:11:45.279116+0000","last_became_active":"2024-09-22T03:11:41.502557+0000","last_became_peered":"2024-09-22T03:11:41.502557+0000","last_unstale":"2024-09-22T03:11:45.279116+0000","last_undegraded":"2024-09-22T03:11:45.279116+0000","last_fullsized":"2024-09-22T03:11:45.279116+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"50'95","reported_seq":108,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.399294+0000","last_change":"2024-09-22T03:11:41.551304+0000","last_active":"2024-09-22T03:11:46.399294+0000","last_peered":"2024-09-22T03:11:46.399294+0000","last_clean":"2024-09-22T03:11:46.399294+0000","last_became_active":"2024-09-22T03:11:41.543833+0000","last_became_peered":"2024-09-22T03:11:41.543833+0000","last_unstale":"2024-09-22T03:11:46.399294+0000","last_undegraded":"2024-09-22T03:11:46.399294+0000","last_fullsized":"2024-09-22T03:11:46.399294+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.436288+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:11:42.436288+0000","last_peered":"2024-09-22T03:11:42.436288+0000","last_clean":"2024-09-22T03:11:42.436288+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:11:42.436288+0000","last_undegraded":"2024-09-22T03:11:42.436288+0000","last_fullsized":"2024-09-22T03:11:42.436288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"50'119","reported_seq":132,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.626009+0000","last_change":"2024-09-22T03:11:41.524387+0000","last_active":"2024-09-22T03:11:46.626009+0000","last_peered":"2024-09-22T03:11:46.626009+0000","last_clean":"2024-09-22T03:11:46.626009+0000","last_became_active":"2024-09-22T03:11:41.517799+0000","last_became_peered":"2024-09-22T03:11:41.517799+0000","last_unstale":"2024-09-22T03:11:46.626009+0000","last_undegraded":"2024-09-22T03:11:46.626009+0000","last_fullsized":"2024-09-22T03:11:46.626009+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437908+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:11:42.437908+0000","last_peered":"2024-09-22T03:11:42.437908+0000","last_clean":"2024-09-22T03:11:42.437908+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:11:42.437908+0000","last_undegraded":"2024-09-22T03:11:42.437908+0000","last_fullsized":"2024-09-22T03:11:42.437908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"50'79","reported_seq":92,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.711144+0000","last_change":"2024-09-22T03:11:41.577187+0000","last_active":"2024-09-22T03:11:46.711144+0000","last_peered":"2024-09-22T03:11:46.711144+0000","last_clean":"2024-09-22T03:11:46.711144+0000","last_became_active":"2024-09-22T03:11:41.553906+0000","last_became_peered":"2024-09-22T03:11:41.553906+0000","last_unstale":"2024-09-22T03:11:46.711144+0000","last_undegraded":"2024-09-22T03:11:46.711144+0000","last_fullsized":"2024-09-22T03:11:46.711144+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":126,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.433377+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:11:42.433377+0000","last_peered":"2024-09-22T03:11:42.433377+0000","last_clean":"2024-09-22T03:11:42.433377+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:11:42.433377+0000","last_undegraded":"2024-09-22T03:11:42.433377+0000","last_fullsized":"2024-09-22T03:11:42.433377+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"50'79","reported_seq":92,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.511702+0000","last_change":"2024-09-22T03:11:41.534290+0000","last_active":"2024-09-22T03:11:46.511702+0000","last_peered":"2024-09-22T03:11:46.511702+0000","last_clean":"2024-09-22T03:11:46.511702+0000","last_became_active":"2024-09-22T03:11:41.529404+0000","last_became_peered":"2024-09-22T03:11:41.529404+0000","last_unstale":"2024-09-22T03:11:46.511702+0000","last_undegraded":"2024-09-22T03:11:46.511702+0000","last_fullsized":"2024-09-22T03:11:46.511702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":125,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437423+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:11:42.437423+0000","last_peered":"2024-09-22T03:11:42.437423+0000","last_clean":"2024-09-22T03:11:42.437423+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:11:42.437423+0000","last_undegraded":"2024-09-22T03:11:42.437423+0000","last_fullsized":"2024-09-22T03:11:42.437423+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441374+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:11:42.441374+0000","last_peered":"2024-09-22T03:11:42.441374+0000","last_clean":"2024-09-22T03:11:42.441374+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:11:42.441374+0000","last_undegraded":"2024-09-22T03:11:42.441374+0000","last_fullsized":"2024-09-22T03:11:42.441374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"50'95","reported_seq":108,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.678433+0000","last_change":"2024-09-22T03:11:41.531581+0000","last_active":"2024-09-22T03:11:46.678433+0000","last_peered":"2024-09-22T03:11:46.678433+0000","last_clean":"2024-09-22T03:11:46.678433+0000","last_became_active":"2024-09-22T03:11:41.525831+0000","last_became_peered":"2024-09-22T03:11:41.525831+0000","last_unstale":"2024-09-22T03:11:46.678433+0000","last_undegraded":"2024-09-22T03:11:46.678433+0000","last_fullsized":"2024-09-22T03:11:46.678433+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.439011+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:11:42.439011+0000","last_peered":"2024-09-22T03:11:42.439011+0000","last_clean":"2024-09-22T03:11:42.439011+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:11:42.439011+0000","last_undegraded":"2024-09-22T03:11:42.439011+0000","last_fullsized":"2024-09-22T03:11:42.439011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"50'79","reported_seq":92,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:44.705165+0000","last_change":"2024-09-22T03:11:41.533626+0000","last_active":"2024-09-22T03:11:44.705165+0000","last_peered":"2024-09-22T03:11:44.705165+0000","last_clean":"2024-09-22T03:11:44.705165+0000","last_became_active":"2024-09-22T03:11:41.527097+0000","last_became_peered":"2024-09-22T03:11:41.527097+0000","last_unstale":"2024-09-22T03:11:44.705165+0000","last_undegraded":"2024-09-22T03:11:44.705165+0000","last_fullsized":"2024-09-22T03:11:44.705165+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.438284+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:11:42.438284+0000","last_peered":"2024-09-22T03:11:42.438284+0000","last_clean":"2024-09-22T03:11:42.438284+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:11:42.438284+0000","last_undegraded":"2024-09-22T03:11:42.438284+0000","last_fullsized":"2024-09-22T03:11:42.438284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"50'135","reported_seq":148,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:46.456174+0000","last_change":"2024-09-22T03:11:41.522320+0000","last_active":"2024-09-22T03:11:46.456174+0000","last_peered":"2024-09-22T03:11:46.456174+0000","last_clean":"2024-09-22T03:11:46.456174+0000","last_became_active":"2024-09-22T03:11:41.514872+0000","last_became_peered":"2024-09-22T03:11:41.514872+0000","last_unstale":"2024-09-22T03:11:46.456174+0000","last_undegraded":"2024-09-22T03:11:46.456174+0000","last_fullsized":"2024-09-22T03:11:46.456174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.442945+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:11:42.442945+0000","last_peered":"2024-09-22T03:11:42.442945+0000","last_clean":"2024-09-22T03:11:42.442945+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:11:42.442945+0000","last_undegraded":"2024-09-22T03:11:42.442945+0000","last_fullsized":"2024-09-22T03:11:42.442945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"50'55","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:45.209979+0000","last_change":"2024-09-22T03:11:41.514921+0000","last_active":"2024-09-22T03:11:45.209979+0000","last_peered":"2024-09-22T03:11:45.209979+0000","last_clean":"2024-09-22T03:11:45.209979+0000","last_became_active":"2024-09-22T03:11:41.509520+0000","last_became_peered":"2024-09-22T03:11:41.509520+0000","last_unstale":"2024-09-22T03:11:45.209979+0000","last_undegraded":"2024-09-22T03:11:45.209979+0000","last_fullsized":"2024-09-22T03:11:45.209979+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441783+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:11:42.441783+0000","last_peered":"2024-09-22T03:11:42.441783+0000","last_clean":"2024-09-22T03:11:42.441783+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:11:42.441783+0000","last_undegraded":"2024-09-22T03:11:42.441783+0000","last_fullsized":"2024-09-22T03:11:42.441783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":11640832,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1421,"num_write_kb":11368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16461824,"data_stored":32923648,"data_compressed":1696707,"data_compressed_allocated":16461824,"data_compressed_original":32923648,"omap_allocated":0,"internal_metadata":0},"log_size":1405,"ondisk_log_size":1405,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42508,"kb_used_data":5116,"kb_used_omap":0,"kb_used_meta":37376,"kb_avail":94329332,"statfs":{"total":96636764160,"available":96593235968,"internally_reserved":0,"allocated":5238784,"data_stored":9762912,"data_compressed":495133,"data_compressed_allocated":4804608,"data_compressed_original":9609216,"omap_allocated":0,"internal_metadata":38273024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128788,"kb_used_data":3396,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94243052,"statfs":{"total":96636764160,"available":96504885248,"internally_reserved":0,"allocated":3477504,"data_stored":6707840,"data_compressed":337244,"data_compressed_allocated":3022848,"data_compressed_original":6537216,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40940,"kb_used_data":4572,"kb_used_omap":0,"kb_used_meta":36352,"kb_avail":94330900,"statfs":{"total":96636764160,"available":96594841600,"internally_reserved":0,"allocated":4681728,"data_stored":9116288,"data_compressed":461356,"data_compressed_allocated":4227072,"data_compressed_original":8945664,"omap_allocated":0,"internal_metadata":37224448},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43152,"kb_used_data":2684,"kb_used_omap":0,"kb_used_meta":40448,"kb_avail":94328688,"statfs":{"total":96636764160,"available":96592576512,"internally_reserved":0,"allocated":2748416,"data_stored":5257837,"data_compressed":262384,"data_compressed_allocated":2297856,"data_compressed_original":5087232,"omap_allocated":0,"internal_metadata":41418752},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2703360,"data_stored":5406720,"data_compressed":278466,"data_compressed_allocated":2703360,"data_compressed_original":5406720,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4882432,"data_stored":9764864,"data_compressed":503306,"data_compressed_allocated":4882432,"data_compressed_original":9764864,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3305472,"data_stored":6610944,"data_compressed":340701,"data_compressed_allocated":3305472,"data_compressed_original":6610944,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5570560,"data_stored":11141120,"data_compressed":574234,"data_compressed_allocated":5570560,"data_compressed_original":11141120,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:11:50.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 8 16 2756 2740 2.67558 2.67969 0.0627994 0.0465518 2024-09-22T03:11:51.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 9 16 3108 3092 2.68382 2.75 0.040353 0.0464564 2024-09-22T03:11:52.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:52.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:52.490+0000 7f5130e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:52.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:52.494+0000 7f5130e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:52.510 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 10 16 3436 3420 2.67167 2.5625 0.0554382 0.0466614 2024-09-22T03:11:53.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 11 16 3780 3764 2.67309 2.6875 0.0187352 0.0466155 2024-09-22T03:11:54.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 12 16 4143 4127 2.68665 2.83594 0.0330604 0.046451 2024-09-22T03:11:54.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:54.794+0000 7ff46bb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:54.802+0000 7ff46bb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:55.267 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:11:55.267 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:11:55.267 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:11:55.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:11:55.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:55.417+0000 7fa7a0117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:55.426+0000 7fa7a0117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:55.451 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:55.451 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:55.451 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:55.451 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:55.451 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:55.451 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:55.451 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:55.451 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:55.451 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:55.451 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:55.452 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:55.452 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:55.457 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:55.457 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:55.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:11:55.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 13 16 4456 4440 2.66807 2.44531 0.0674264 0.046724 2024-09-22T03:11:55.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:55.580+0000 7f488ad57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:55.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:55.594+0000 7f488ad57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:55.669 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:55.669 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:55.669 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:55.669 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:55.669 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:55.669 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:55.669 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:55.669 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:55.670 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:55.670 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:55.670 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:55.670 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:55.672 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:55.672 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:55.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:11:55.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:55.802+0000 7f2fc9ece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:55.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:55.815+0000 7f2fc9ece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:55.837 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:55.837 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:55.837 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:11:55.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:55.967+0000 7f50cab57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:55.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:55.976+0000 7f50cab57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:56.063 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:11:56.063 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:11:56.063 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:11:56.063 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:11:56.064 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:11:56.064 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:11:56.064 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:11:56.064 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:11:56.064 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:11:56.064 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:11:56.064 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:11:56.064 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:11:56.066 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:11:56.066 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:11:56.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 14 16 4787 4771 2.66219 2.58594 0.0610148 0.0468393 2024-09-22T03:11:57.002 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:11:57.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:57.122+0000 7f0f302ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:57.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:57.131+0000 7f0f302ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:57.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 15 16 5127 5111 2.66178 2.65625 0.0340464 0.0469033 2024-09-22T03:11:58.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 16 16 5464 5448 2.65995 2.63281 0.0353714 0.0469302 2024-09-22T03:11:59.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:11:59.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:59.390+0000 7f0f90917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:59.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:11:59.396+0000 7f0f90917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:11:59.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 17 16 5773 5757 2.64547 2.41406 0.0197659 0.0471619 2024-09-22T03:12:00.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 18 16 6115 6099 2.64693 2.67188 0.0597944 0.0471226 2024-09-22T03:12:01.067 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:12:01.067 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:12:01.067 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:12:01.067 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:12:01.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:01.175+0000 7f4c96223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:01.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:01.184+0000 7f4c96223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:01.208 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:01.208 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:01.209 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:12:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:01.356+0000 7f4bc0018640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:01.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:01.366+0000 7f4bc0018640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:01.384 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:01.384 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:01.384 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:01.384 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:01.384 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:01.384 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:01.384 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:01.384 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:01.384 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:01.385 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:01.385 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:01.385 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:01.387 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:01.388 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:01.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:12:01.511 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 19 16 6455 6439 2.64741 2.65625 0.0354879 0.0471627 2024-09-22T03:12:01.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:01.506+0000 7f9329b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:01.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:01.520+0000 7f9329b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:01.545 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:01.545 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:01.545 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:12:01.640 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:01.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:01.682+0000 7fedeec63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:01.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:01.695+0000 7fedeec63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:01.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:01.765 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:01.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:01.772+0000 7fc850d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:01.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:01.779+0000 7fc850d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:02.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:12:02.510961+0000 min lat: 0.00893235 max lat: 0.149088 avg lat: 0.0474331 2024-09-22T03:12:02.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:12:02.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 20 16 6751 6735 2.63065 2.3125 0.0489002 0.0474331 2024-09-22T03:12:03.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 21 16 7070 7054 2.62404 2.49219 0.0270249 0.0475766 2024-09-22T03:12:03.985 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:04.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:04.096+0000 7fc28306c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:04.102+0000 7fc28306c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:04.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 22 16 7398 7382 2.62123 2.5625 0.0336144 0.0476457 2024-09-22T03:12:05.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 23 16 7706 7690 2.61188 2.40625 0.0188983 0.0477947 2024-09-22T03:12:06.382 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:06.488+0000 7f256f357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:06.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:06.493+0000 7f256f357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:06.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 24 16 8020 8004 2.60526 2.45312 0.065598 0.0479108 2024-09-22T03:12:06.766 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:12:06.767 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:12:06.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:12:06.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:06.905+0000 7fb23f917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:06.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:06.913+0000 7fb23f917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:12:07.221 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:12:07.240 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-22T03:12:06.773529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":62194227,"num_objects":944,"num_object_clones":0,"num_object_copies":2832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7659,"num_write_kb":62056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7604,"ondisk_log_size":7604,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":338060,"kb_used_data":90124,"kb_used_omap":0,"kb_used_meta":247872,"kb_avail":377149300,"statfs":{"total":386547056640,"available":386200883200,"internally_reserved":0,"allocated":92286976,"data_stored":183125965,"data_compressed":9419199,"data_compressed_allocated":90492928,"data_compressed_original":182460416,"omap_allocated":0,"internal_metadata":253820928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35610624,"num_objects":542,"num_object_clones":0,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4347,"num_write_kb":34776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001931"},"pg_stats":[{"pgid":"7.f","version":"50'375","reported_seq":388,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:01.729267+0000","last_change":"2024-09-22T03:11:41.549868+0000","last_active":"2024-09-22T03:12:01.729267+0000","last_peered":"2024-09-22T03:12:01.729267+0000","last_clean":"2024-09-22T03:12:01.729267+0000","last_became_active":"2024-09-22T03:11:41.545171+0000","last_became_peered":"2024-09-22T03:11:41.545171+0000","last_unstale":"2024-09-22T03:12:01.729267+0000","last_undegraded":"2024-09-22T03:12:01.729267+0000","last_fullsized":"2024-09-22T03:12:01.729267+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"50'543","reported_seq":556,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:06.705930+0000","last_change":"2024-09-22T03:11:41.496023+0000","last_active":"2024-09-22T03:12:06.705930+0000","last_peered":"2024-09-22T03:12:06.705930+0000","last_clean":"2024-09-22T03:12:06.705930+0000","last_became_active":"2024-09-22T03:11:41.492941+0000","last_became_peered":"2024-09-22T03:11:41.492941+0000","last_unstale":"2024-09-22T03:12:06.705930+0000","last_undegraded":"2024-09-22T03:12:06.705930+0000","last_fullsized":"2024-09-22T03:12:06.705930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"50'495","reported_seq":508,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:06.505217+0000","last_change":"2024-09-22T03:11:41.523699+0000","last_active":"2024-09-22T03:12:06.505217+0000","last_peered":"2024-09-22T03:12:06.505217+0000","last_clean":"2024-09-22T03:12:06.505217+0000","last_became_active":"2024-09-22T03:11:41.520422+0000","last_became_peered":"2024-09-22T03:11:41.520422+0000","last_unstale":"2024-09-22T03:12:06.505217+0000","last_undegraded":"2024-09-22T03:12:06.505217+0000","last_fullsized":"2024-09-22T03:12:06.505217+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"50'535","reported_seq":548,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:06.266695+0000","last_change":"2024-09-22T03:11:41.513541+0000","last_active":"2024-09-22T03:12:06.266695+0000","last_peered":"2024-09-22T03:12:06.266695+0000","last_clean":"2024-09-22T03:12:06.266695+0000","last_became_active":"2024-09-22T03:11:41.509909+0000","last_became_peered":"2024-09-22T03:11:41.509909+0000","last_unstale":"2024-09-22T03:12:06.266695+0000","last_undegraded":"2024-09-22T03:12:06.266695+0000","last_fullsized":"2024-09-22T03:12:06.266695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'423","reported_seq":436,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:01.525391+0000","last_change":"2024-09-22T03:11:41.518404+0000","last_active":"2024-09-22T03:12:01.525391+0000","last_peered":"2024-09-22T03:12:01.525391+0000","last_clean":"2024-09-22T03:12:01.525391+0000","last_became_active":"2024-09-22T03:11:41.513810+0000","last_became_peered":"2024-09-22T03:11:41.513810+0000","last_unstale":"2024-09-22T03:12:01.525391+0000","last_undegraded":"2024-09-22T03:12:01.525391+0000","last_fullsized":"2024-09-22T03:12:01.525391+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"50'367","reported_seq":380,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:01.065332+0000","last_change":"2024-09-22T03:11:41.507457+0000","last_active":"2024-09-22T03:12:01.065332+0000","last_peered":"2024-09-22T03:12:01.065332+0000","last_clean":"2024-09-22T03:12:01.065332+0000","last_became_active":"2024-09-22T03:11:41.496687+0000","last_became_peered":"2024-09-22T03:11:41.496687+0000","last_unstale":"2024-09-22T03:12:01.065332+0000","last_undegraded":"2024-09-22T03:12:01.065332+0000","last_fullsized":"2024-09-22T03:12:01.065332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"50'543","reported_seq":556,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:06.379768+0000","last_change":"2024-09-22T03:11:41.548004+0000","last_active":"2024-09-22T03:12:06.379768+0000","last_peered":"2024-09-22T03:12:06.379768+0000","last_clean":"2024-09-22T03:12:06.379768+0000","last_became_active":"2024-09-22T03:11:41.541878+0000","last_became_peered":"2024-09-22T03:11:41.541878+0000","last_unstale":"2024-09-22T03:12:06.379768+0000","last_undegraded":"2024-09-22T03:12:06.379768+0000","last_fullsized":"2024-09-22T03:12:06.379768+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"50'399","reported_seq":412,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:06.288965+0000","last_change":"2024-09-22T03:11:41.507878+0000","last_active":"2024-09-22T03:12:06.288965+0000","last_peered":"2024-09-22T03:12:06.288965+0000","last_clean":"2024-09-22T03:12:06.288965+0000","last_became_active":"2024-09-22T03:11:41.502557+0000","last_became_peered":"2024-09-22T03:11:41.502557+0000","last_unstale":"2024-09-22T03:12:06.288965+0000","last_undegraded":"2024-09-22T03:12:06.288965+0000","last_fullsized":"2024-09-22T03:12:06.288965+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"50'359","reported_seq":372,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:01.328226+0000","last_change":"2024-09-22T03:11:41.551304+0000","last_active":"2024-09-22T03:12:01.328226+0000","last_peered":"2024-09-22T03:12:01.328226+0000","last_clean":"2024-09-22T03:12:01.328226+0000","last_became_active":"2024-09-22T03:11:41.543833+0000","last_became_peered":"2024-09-22T03:11:41.543833+0000","last_unstale":"2024-09-22T03:12:01.328226+0000","last_undegraded":"2024-09-22T03:12:01.328226+0000","last_fullsized":"2024-09-22T03:12:01.328226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.436288+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:11:42.436288+0000","last_peered":"2024-09-22T03:11:42.436288+0000","last_clean":"2024-09-22T03:11:42.436288+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:11:42.436288+0000","last_undegraded":"2024-09-22T03:11:42.436288+0000","last_fullsized":"2024-09-22T03:11:42.436288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"50'655","reported_seq":668,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:06.127847+0000","last_change":"2024-09-22T03:11:41.524387+0000","last_active":"2024-09-22T03:12:06.127847+0000","last_peered":"2024-09-22T03:12:06.127847+0000","last_clean":"2024-09-22T03:12:06.127847+0000","last_became_active":"2024-09-22T03:11:41.517799+0000","last_became_peered":"2024-09-22T03:11:41.517799+0000","last_unstale":"2024-09-22T03:12:06.127847+0000","last_undegraded":"2024-09-22T03:12:06.127847+0000","last_fullsized":"2024-09-22T03:12:06.127847+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437908+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:11:42.437908+0000","last_peered":"2024-09-22T03:11:42.437908+0000","last_clean":"2024-09-22T03:11:42.437908+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:11:42.437908+0000","last_undegraded":"2024-09-22T03:11:42.437908+0000","last_fullsized":"2024-09-22T03:11:42.437908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"50'431","reported_seq":444,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:06.328077+0000","last_change":"2024-09-22T03:11:41.577187+0000","last_active":"2024-09-22T03:12:06.328077+0000","last_peered":"2024-09-22T03:12:06.328077+0000","last_clean":"2024-09-22T03:12:06.328077+0000","last_became_active":"2024-09-22T03:11:41.553906+0000","last_became_peered":"2024-09-22T03:11:41.553906+0000","last_unstale":"2024-09-22T03:12:06.328077+0000","last_undegraded":"2024-09-22T03:12:06.328077+0000","last_fullsized":"2024-09-22T03:12:06.328077+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":126,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.433377+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:11:42.433377+0000","last_peered":"2024-09-22T03:11:42.433377+0000","last_clean":"2024-09-22T03:11:42.433377+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:11:42.433377+0000","last_undegraded":"2024-09-22T03:11:42.433377+0000","last_fullsized":"2024-09-22T03:11:42.433377+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"50'463","reported_seq":476,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:05.525791+0000","last_change":"2024-09-22T03:11:41.534290+0000","last_active":"2024-09-22T03:12:05.525791+0000","last_peered":"2024-09-22T03:12:05.525791+0000","last_clean":"2024-09-22T03:12:05.525791+0000","last_became_active":"2024-09-22T03:11:41.529404+0000","last_became_peered":"2024-09-22T03:11:41.529404+0000","last_unstale":"2024-09-22T03:12:05.525791+0000","last_undegraded":"2024-09-22T03:12:05.525791+0000","last_fullsized":"2024-09-22T03:12:05.525791+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":125,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437423+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:11:42.437423+0000","last_peered":"2024-09-22T03:11:42.437423+0000","last_clean":"2024-09-22T03:11:42.437423+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:11:42.437423+0000","last_undegraded":"2024-09-22T03:11:42.437423+0000","last_fullsized":"2024-09-22T03:11:42.437423+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441374+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:11:42.441374+0000","last_peered":"2024-09-22T03:11:42.441374+0000","last_clean":"2024-09-22T03:11:42.441374+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:11:42.441374+0000","last_undegraded":"2024-09-22T03:11:42.441374+0000","last_fullsized":"2024-09-22T03:11:42.441374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"50'423","reported_seq":436,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:01.625379+0000","last_change":"2024-09-22T03:11:41.531581+0000","last_active":"2024-09-22T03:12:01.625379+0000","last_peered":"2024-09-22T03:12:01.625379+0000","last_clean":"2024-09-22T03:12:01.625379+0000","last_became_active":"2024-09-22T03:11:41.525831+0000","last_became_peered":"2024-09-22T03:11:41.525831+0000","last_unstale":"2024-09-22T03:12:01.625379+0000","last_undegraded":"2024-09-22T03:12:01.625379+0000","last_fullsized":"2024-09-22T03:12:01.625379+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.439011+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:11:42.439011+0000","last_peered":"2024-09-22T03:11:42.439011+0000","last_clean":"2024-09-22T03:11:42.439011+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:11:42.439011+0000","last_undegraded":"2024-09-22T03:11:42.439011+0000","last_fullsized":"2024-09-22T03:11:42.439011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"50'359","reported_seq":372,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:01.401382+0000","last_change":"2024-09-22T03:11:41.533626+0000","last_active":"2024-09-22T03:12:01.401382+0000","last_peered":"2024-09-22T03:12:01.401382+0000","last_clean":"2024-09-22T03:12:01.401382+0000","last_became_active":"2024-09-22T03:11:41.527097+0000","last_became_peered":"2024-09-22T03:11:41.527097+0000","last_unstale":"2024-09-22T03:12:01.401382+0000","last_undegraded":"2024-09-22T03:12:01.401382+0000","last_fullsized":"2024-09-22T03:12:01.401382+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.438284+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:11:42.438284+0000","last_peered":"2024-09-22T03:11:42.438284+0000","last_clean":"2024-09-22T03:11:42.438284+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:11:42.438284+0000","last_undegraded":"2024-09-22T03:11:42.438284+0000","last_fullsized":"2024-09-22T03:11:42.438284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"50'671","reported_seq":684,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:06.730444+0000","last_change":"2024-09-22T03:11:41.522320+0000","last_active":"2024-09-22T03:12:06.730444+0000","last_peered":"2024-09-22T03:12:06.730444+0000","last_clean":"2024-09-22T03:12:06.730444+0000","last_became_active":"2024-09-22T03:11:41.514872+0000","last_became_peered":"2024-09-22T03:11:41.514872+0000","last_unstale":"2024-09-22T03:12:06.730444+0000","last_undegraded":"2024-09-22T03:12:06.730444+0000","last_fullsized":"2024-09-22T03:12:06.730444+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.442945+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:11:42.442945+0000","last_peered":"2024-09-22T03:11:42.442945+0000","last_clean":"2024-09-22T03:11:42.442945+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:11:42.442945+0000","last_undegraded":"2024-09-22T03:11:42.442945+0000","last_fullsized":"2024-09-22T03:11:42.442945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"50'463","reported_seq":476,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:05.411153+0000","last_change":"2024-09-22T03:11:41.514921+0000","last_active":"2024-09-22T03:12:05.411153+0000","last_peered":"2024-09-22T03:12:05.411153+0000","last_clean":"2024-09-22T03:12:05.411153+0000","last_became_active":"2024-09-22T03:11:41.509520+0000","last_became_peered":"2024-09-22T03:11:41.509520+0000","last_unstale":"2024-09-22T03:12:05.411153+0000","last_undegraded":"2024-09-22T03:12:05.411153+0000","last_fullsized":"2024-09-22T03:12:05.411153+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441783+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:11:42.441783+0000","last_peered":"2024-09-22T03:11:42.441783+0000","last_clean":"2024-09-22T03:11:42.441783+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:11:42.441783+0000","last_undegraded":"2024-09-22T03:11:42.441783+0000","last_fullsized":"2024-09-22T03:11:42.441783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":61603840,"num_objects":940,"num_object_clones":0,"num_object_copies":2820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7520,"num_write_kb":60160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":92319744,"data_stored":184639488,"data_compressed":9530667,"data_compressed_allocated":92319744,"data_compressed_original":184639488,"omap_allocated":0,"internal_metadata":0},"log_size":7504,"ondisk_log_size":7504,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673424,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61456,"kb_used_data":24064,"kb_used_omap":0,"kb_used_meta":37376,"kb_avail":94310384,"statfs":{"total":96636764160,"available":96573833216,"internally_reserved":0,"allocated":24641536,"data_stored":48568416,"data_compressed":2498884,"data_compressed_allocated":24207360,"data_compressed_original":48414720,"omap_allocated":0,"internal_metadata":38273024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143976,"kb_used_data":18584,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94227864,"statfs":{"total":96636764160,"available":96489332736,"internally_reserved":0,"allocated":19030016,"data_stored":37812864,"data_compressed":1943375,"data_compressed_allocated":18575360,"data_compressed_original":37642240,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71592,"kb_used_data":26904,"kb_used_omap":0,"kb_used_meta":44672,"kb_avail":94300248,"statfs":{"total":96636764160,"available":96563453952,"internally_reserved":0,"allocated":27549696,"data_stored":54852224,"data_compressed":2822965,"data_compressed_allocated":27095040,"data_compressed_original":54681600,"omap_allocated":0,"internal_metadata":45744128},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706133,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61036,"kb_used_data":20572,"kb_used_omap":0,"kb_used_meta":40448,"kb_avail":94310804,"statfs":{"total":96636764160,"available":96574263296,"internally_reserved":0,"allocated":21065728,"data_stored":41892461,"data_compressed":2153975,"data_compressed_allocated":20615168,"data_compressed_original":41721856,"omap_allocated":0,"internal_metadata":41418752},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21061632,"data_stored":42123264,"data_compressed":2174352,"data_compressed_allocated":21061632,"data_compressed_original":42123264,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27516928,"data_stored":55033856,"data_compressed":2840804,"data_compressed_allocated":27516928,"data_compressed_original":55033856,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18907136,"data_stored":37814272,"data_compressed":1951908,"data_compressed_allocated":18907136,"data_compressed_original":37814272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24834048,"data_stored":49668096,"data_compressed":2563603,"data_compressed_allocated":24834048,"data_compressed_original":49668096,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:12:07.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 25 16 8303 8287 2.58948 2.21094 0.054738 0.0481895 2024-09-22T03:12:08.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 26 16 8626 8610 2.58693 2.52344 0.0399203 0.0482732 2024-09-22T03:12:08.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:08.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:08.818+0000 7f58b4e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:08.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:08.823+0000 7f58b4e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:09.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 27 15 8941 8926 2.58255 2.46875 0.0570318 0.0483563 2024-09-22T03:12:10.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 28 16 9265 9249 2.58043 2.52344 0.0499339 0.048393 2024-09-22T03:12:11.000 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:11.118+0000 7efca16b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:11.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:11.124+0000 7efca16b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:11.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 29 16 9569 9553 2.57334 2.375 0.0602236 0.0485159 2024-09-22T03:12:12.242 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:12:12.242 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:12:12.242 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:12:12.242 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:12:12.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:12.376+0000 7ff500258640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:12.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:12.385+0000 7ff500258640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:12.404 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:12.407 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:12.407 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:12.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:12:12.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 30 16 9876 9860 2.5675 2.39844 0.0217357 0.04861 2024-09-22T03:12:12.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:12.524+0000 7f099b463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:12.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:12.536+0000 7f099b463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:12.614 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:12.614 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:12.614 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:12.614 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:12.614 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:12.614 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:12.614 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:12.615 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:12.615 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:12.615 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:12.615 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:12.615 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:12.617 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:12.617 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:12.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:12:12.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:12.758+0000 7f048a0fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:12.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:12.769+0000 7f048a0fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:12.825 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:12.825 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:12.825 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:12.825 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:12.825 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:12.825 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:12.826 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:12.826 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:12.826 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:12.826 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:12.826 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:12.826 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:12.828 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:12.829 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:12.829 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:12:12.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:12.937+0000 7f2ed68ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:12.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:12.945+0000 7f2ed68ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:13.033 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:13.034 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:13.034 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:13.034 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:13.034 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:13.034 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:13.034 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:13.034 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:13.034 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:13.034 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:13.034 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:13.034 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:13.037 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:13.037 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:13.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:13.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:13.489+0000 7fd86274e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:13.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:13.495+0000 7fd86274e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:13.512 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 31 16 10115 10099 2.5449 1.86719 0.0347965 0.0490739 2024-09-22T03:12:14.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 32 16 10380 10364 2.53007 2.07031 0.0318753 0.0493576 2024-09-22T03:12:15.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 33 16 10681 10665 2.52465 2.35156 0.0572667 0.0494649 2024-09-22T03:12:15.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:15.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:15.895+0000 7f6b64063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:15.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:15.901+0000 7f6b64063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:16.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 34 16 10937 10921 2.50921 2 0.0262949 0.0497649 2024-09-22T03:12:17.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 35 16 11249 11233 2.50716 2.4375 0.0478216 0.049821 2024-09-22T03:12:18.038 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:12:18.038 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:12:18.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:12:18.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:18.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:18.166+0000 7f6e53663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:18.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:18.177+0000 7f6e53663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:18.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:18.232+0000 7f385710e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:18.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:18.240+0000 7f385710e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:12:18.439 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:12:18.456 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-22T03:12:16.775311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":90661427,"num_objects":1380,"num_object_clones":0,"num_object_copies":4140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":11134,"num_write_kb":89856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11079,"ondisk_log_size":11079,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":278288,"kb_used_data":131400,"kb_used_omap":0,"kb_used_meta":146816,"kb_avail":377209072,"statfs":{"total":386547056640,"available":386262089728,"internally_reserved":0,"allocated":134553600,"data_stored":267659213,"data_compressed":13784136,"data_compressed_allocated":132759552,"data_compressed_original":266993664,"omap_allocated":0,"internal_metadata":150339584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":36708352,"num_objects":561,"num_object_clones":0,"num_object_copies":1683,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4481,"num_write_kb":35848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002056"},"pg_stats":[{"pgid":"7.f","version":"50'631","reported_seq":644,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.711392+0000","last_change":"2024-09-22T03:11:41.549868+0000","last_active":"2024-09-22T03:12:16.711392+0000","last_peered":"2024-09-22T03:12:16.711392+0000","last_clean":"2024-09-22T03:12:16.711392+0000","last_became_active":"2024-09-22T03:11:41.545171+0000","last_became_peered":"2024-09-22T03:11:41.545171+0000","last_unstale":"2024-09-22T03:12:16.711392+0000","last_undegraded":"2024-09-22T03:12:16.711392+0000","last_fullsized":"2024-09-22T03:12:16.711392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"50'743","reported_seq":756,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:15.711638+0000","last_change":"2024-09-22T03:11:41.496023+0000","last_active":"2024-09-22T03:12:15.711638+0000","last_peered":"2024-09-22T03:12:15.711638+0000","last_clean":"2024-09-22T03:12:15.711638+0000","last_became_active":"2024-09-22T03:11:41.492941+0000","last_became_peered":"2024-09-22T03:11:41.492941+0000","last_unstale":"2024-09-22T03:12:15.711638+0000","last_undegraded":"2024-09-22T03:12:15.711638+0000","last_fullsized":"2024-09-22T03:12:15.711638+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"50'703","reported_seq":716,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.514317+0000","last_change":"2024-09-22T03:11:41.523699+0000","last_active":"2024-09-22T03:12:16.514317+0000","last_peered":"2024-09-22T03:12:16.514317+0000","last_clean":"2024-09-22T03:12:16.514317+0000","last_became_active":"2024-09-22T03:11:41.520422+0000","last_became_peered":"2024-09-22T03:11:41.520422+0000","last_unstale":"2024-09-22T03:12:16.514317+0000","last_undegraded":"2024-09-22T03:12:16.514317+0000","last_fullsized":"2024-09-22T03:12:16.514317+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"50'695","reported_seq":708,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.237015+0000","last_change":"2024-09-22T03:11:41.513541+0000","last_active":"2024-09-22T03:12:16.237015+0000","last_peered":"2024-09-22T03:12:16.237015+0000","last_clean":"2024-09-22T03:12:16.237015+0000","last_became_active":"2024-09-22T03:11:41.509909+0000","last_became_peered":"2024-09-22T03:11:41.509909+0000","last_unstale":"2024-09-22T03:12:16.237015+0000","last_undegraded":"2024-09-22T03:12:16.237015+0000","last_fullsized":"2024-09-22T03:12:16.237015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'703","reported_seq":716,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.549297+0000","last_change":"2024-09-22T03:11:41.518404+0000","last_active":"2024-09-22T03:12:16.549297+0000","last_peered":"2024-09-22T03:12:16.549297+0000","last_clean":"2024-09-22T03:12:16.549297+0000","last_became_active":"2024-09-22T03:11:41.513810+0000","last_became_peered":"2024-09-22T03:11:41.513810+0000","last_unstale":"2024-09-22T03:12:16.549297+0000","last_undegraded":"2024-09-22T03:12:16.549297+0000","last_fullsized":"2024-09-22T03:12:16.549297+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"50'671","reported_seq":684,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.479372+0000","last_change":"2024-09-22T03:11:41.507457+0000","last_active":"2024-09-22T03:12:16.479372+0000","last_peered":"2024-09-22T03:12:16.479372+0000","last_clean":"2024-09-22T03:12:16.479372+0000","last_became_active":"2024-09-22T03:11:41.496687+0000","last_became_peered":"2024-09-22T03:11:41.496687+0000","last_unstale":"2024-09-22T03:12:16.479372+0000","last_undegraded":"2024-09-22T03:12:16.479372+0000","last_fullsized":"2024-09-22T03:12:16.479372+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"50'711","reported_seq":724,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.593962+0000","last_change":"2024-09-22T03:11:41.548004+0000","last_active":"2024-09-22T03:12:16.593962+0000","last_peered":"2024-09-22T03:12:16.593962+0000","last_clean":"2024-09-22T03:12:16.593962+0000","last_became_active":"2024-09-22T03:11:41.541878+0000","last_became_peered":"2024-09-22T03:11:41.541878+0000","last_unstale":"2024-09-22T03:12:16.593962+0000","last_undegraded":"2024-09-22T03:12:16.593962+0000","last_fullsized":"2024-09-22T03:12:16.593962+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"50'575","reported_seq":588,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:15.227295+0000","last_change":"2024-09-22T03:11:41.507878+0000","last_active":"2024-09-22T03:12:15.227295+0000","last_peered":"2024-09-22T03:12:15.227295+0000","last_clean":"2024-09-22T03:12:15.227295+0000","last_became_active":"2024-09-22T03:11:41.502557+0000","last_became_peered":"2024-09-22T03:11:41.502557+0000","last_unstale":"2024-09-22T03:12:15.227295+0000","last_undegraded":"2024-09-22T03:12:15.227295+0000","last_fullsized":"2024-09-22T03:12:15.227295+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"50'655","reported_seq":668,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.594876+0000","last_change":"2024-09-22T03:11:41.551304+0000","last_active":"2024-09-22T03:12:16.594876+0000","last_peered":"2024-09-22T03:12:16.594876+0000","last_clean":"2024-09-22T03:12:16.594876+0000","last_became_active":"2024-09-22T03:11:41.543833+0000","last_became_peered":"2024-09-22T03:11:41.543833+0000","last_unstale":"2024-09-22T03:12:16.594876+0000","last_undegraded":"2024-09-22T03:12:16.594876+0000","last_fullsized":"2024-09-22T03:12:16.594876+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.436288+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:11:42.436288+0000","last_peered":"2024-09-22T03:11:42.436288+0000","last_clean":"2024-09-22T03:11:42.436288+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:11:42.436288+0000","last_undegraded":"2024-09-22T03:11:42.436288+0000","last_fullsized":"2024-09-22T03:11:42.436288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"50'879","reported_seq":892,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.712273+0000","last_change":"2024-09-22T03:11:41.524387+0000","last_active":"2024-09-22T03:12:16.712273+0000","last_peered":"2024-09-22T03:12:16.712273+0000","last_clean":"2024-09-22T03:12:16.712273+0000","last_became_active":"2024-09-22T03:11:41.517799+0000","last_became_peered":"2024-09-22T03:11:41.517799+0000","last_unstale":"2024-09-22T03:12:16.712273+0000","last_undegraded":"2024-09-22T03:12:16.712273+0000","last_fullsized":"2024-09-22T03:12:16.712273+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437908+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:11:42.437908+0000","last_peered":"2024-09-22T03:11:42.437908+0000","last_clean":"2024-09-22T03:11:42.437908+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:11:42.437908+0000","last_undegraded":"2024-09-22T03:11:42.437908+0000","last_fullsized":"2024-09-22T03:11:42.437908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"50'599","reported_seq":612,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.489434+0000","last_change":"2024-09-22T03:11:41.577187+0000","last_active":"2024-09-22T03:12:16.489434+0000","last_peered":"2024-09-22T03:12:16.489434+0000","last_clean":"2024-09-22T03:12:16.489434+0000","last_became_active":"2024-09-22T03:11:41.553906+0000","last_became_peered":"2024-09-22T03:11:41.553906+0000","last_unstale":"2024-09-22T03:12:16.489434+0000","last_undegraded":"2024-09-22T03:12:16.489434+0000","last_fullsized":"2024-09-22T03:12:16.489434+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":126,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.433377+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:11:42.433377+0000","last_peered":"2024-09-22T03:11:42.433377+0000","last_clean":"2024-09-22T03:11:42.433377+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:11:42.433377+0000","last_undegraded":"2024-09-22T03:11:42.433377+0000","last_fullsized":"2024-09-22T03:11:42.433377+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"50'665","reported_seq":678,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.748393+0000","last_change":"2024-09-22T03:11:41.534290+0000","last_active":"2024-09-22T03:12:16.748393+0000","last_peered":"2024-09-22T03:12:16.748393+0000","last_clean":"2024-09-22T03:12:16.748393+0000","last_became_active":"2024-09-22T03:11:41.529404+0000","last_became_peered":"2024-09-22T03:11:41.529404+0000","last_unstale":"2024-09-22T03:12:16.748393+0000","last_undegraded":"2024-09-22T03:12:16.748393+0000","last_fullsized":"2024-09-22T03:12:16.748393+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5455872,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":5328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":125,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437423+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:11:42.437423+0000","last_peered":"2024-09-22T03:11:42.437423+0000","last_clean":"2024-09-22T03:11:42.437423+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:11:42.437423+0000","last_undegraded":"2024-09-22T03:11:42.437423+0000","last_fullsized":"2024-09-22T03:11:42.437423+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441374+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:11:42.441374+0000","last_peered":"2024-09-22T03:11:42.441374+0000","last_clean":"2024-09-22T03:11:42.441374+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:11:42.441374+0000","last_undegraded":"2024-09-22T03:11:42.441374+0000","last_fullsized":"2024-09-22T03:11:42.441374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"50'671","reported_seq":684,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.284244+0000","last_change":"2024-09-22T03:11:41.531581+0000","last_active":"2024-09-22T03:12:16.284244+0000","last_peered":"2024-09-22T03:12:16.284244+0000","last_clean":"2024-09-22T03:12:16.284244+0000","last_became_active":"2024-09-22T03:11:41.525831+0000","last_became_peered":"2024-09-22T03:11:41.525831+0000","last_unstale":"2024-09-22T03:12:16.284244+0000","last_undegraded":"2024-09-22T03:12:16.284244+0000","last_fullsized":"2024-09-22T03:12:16.284244+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.439011+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:11:42.439011+0000","last_peered":"2024-09-22T03:11:42.439011+0000","last_clean":"2024-09-22T03:11:42.439011+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:11:42.439011+0000","last_undegraded":"2024-09-22T03:11:42.439011+0000","last_fullsized":"2024-09-22T03:11:42.439011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"50'599","reported_seq":612,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.642836+0000","last_change":"2024-09-22T03:11:41.533626+0000","last_active":"2024-09-22T03:12:16.642836+0000","last_peered":"2024-09-22T03:12:16.642836+0000","last_clean":"2024-09-22T03:12:16.642836+0000","last_became_active":"2024-09-22T03:11:41.527097+0000","last_became_peered":"2024-09-22T03:11:41.527097+0000","last_unstale":"2024-09-22T03:12:16.642836+0000","last_undegraded":"2024-09-22T03:12:16.642836+0000","last_fullsized":"2024-09-22T03:12:16.642836+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.438284+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:11:42.438284+0000","last_peered":"2024-09-22T03:11:42.438284+0000","last_clean":"2024-09-22T03:11:42.438284+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:11:42.438284+0000","last_undegraded":"2024-09-22T03:11:42.438284+0000","last_fullsized":"2024-09-22T03:11:42.438284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"50'840","reported_seq":853,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:16.177562+0000","last_change":"2024-09-22T03:11:41.522320+0000","last_active":"2024-09-22T03:12:16.177562+0000","last_peered":"2024-09-22T03:12:16.177562+0000","last_clean":"2024-09-22T03:12:16.177562+0000","last_became_active":"2024-09-22T03:11:41.514872+0000","last_became_peered":"2024-09-22T03:11:41.514872+0000","last_unstale":"2024-09-22T03:12:16.177562+0000","last_undegraded":"2024-09-22T03:12:16.177562+0000","last_fullsized":"2024-09-22T03:12:16.177562+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6889472,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":6728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.442945+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:11:42.442945+0000","last_peered":"2024-09-22T03:11:42.442945+0000","last_clean":"2024-09-22T03:11:42.442945+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:11:42.442945+0000","last_undegraded":"2024-09-22T03:11:42.442945+0000","last_fullsized":"2024-09-22T03:11:42.442945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"50'639","reported_seq":652,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:15.725384+0000","last_change":"2024-09-22T03:11:41.514921+0000","last_active":"2024-09-22T03:12:15.725384+0000","last_peered":"2024-09-22T03:12:15.725384+0000","last_clean":"2024-09-22T03:12:15.725384+0000","last_became_active":"2024-09-22T03:11:41.509520+0000","last_became_peered":"2024-09-22T03:11:41.509520+0000","last_unstale":"2024-09-22T03:12:15.725384+0000","last_undegraded":"2024-09-22T03:12:15.725384+0000","last_fullsized":"2024-09-22T03:12:15.725384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441783+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:11:42.441783+0000","last_peered":"2024-09-22T03:11:42.441783+0000","last_clean":"2024-09-22T03:11:42.441783+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:11:42.441783+0000","last_undegraded":"2024-09-22T03:11:42.441783+0000","last_fullsized":"2024-09-22T03:11:42.441783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":90071040,"num_objects":1376,"num_object_clones":0,"num_object_copies":4128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10995,"num_write_kb":87960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134471680,"data_stored":268943360,"data_compressed":13883760,"data_compressed_allocated":134471680,"data_compressed_original":268943360,"omap_allocated":0,"internal_metadata":0},"log_size":10979,"ondisk_log_size":10979,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78276,"kb_used_data":40880,"kb_used_omap":0,"kb_used_meta":37376,"kb_avail":94293564,"statfs":{"total":96636764160,"available":96556609536,"internally_reserved":0,"allocated":41861120,"data_stored":83007584,"data_compressed":4277176,"data_compressed_allocated":41426944,"data_compressed_original":82853888,"omap_allocated":0,"internal_metadata":38273024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66080,"kb_used_data":25100,"kb_used_omap":0,"kb_used_meta":40960,"kb_avail":94305760,"statfs":{"total":96636764160,"available":96569098240,"internally_reserved":0,"allocated":25702400,"data_stored":51157632,"data_compressed":2632442,"data_compressed_allocated":25247744,"data_compressed_original":50987008,"omap_allocated":0,"internal_metadata":41943040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72856,"kb_used_data":36488,"kb_used_omap":0,"kb_used_meta":36352,"kb_avail":94298984,"statfs":{"total":96636764160,"available":96562159616,"internally_reserved":0,"allocated":37363712,"data_stored":74480256,"data_compressed":3836473,"data_compressed_allocated":36909056,"data_compressed_original":74309632,"omap_allocated":0,"internal_metadata":37224448},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61076,"kb_used_data":28932,"kb_used_omap":0,"kb_used_meta":32128,"kb_avail":94310764,"statfs":{"total":96636764160,"available":96574222336,"internally_reserved":0,"allocated":29626368,"data_stored":59013741,"data_compressed":3038045,"data_compressed_allocated":29175808,"data_compressed_original":58843136,"omap_allocated":0,"internal_metadata":32899072},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29577216,"data_stored":59154432,"data_compressed":3053769,"data_compressed_allocated":29577216,"data_compressed_original":59154432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37371904,"data_stored":74743808,"data_compressed":3858542,"data_compressed_allocated":37371904,"data_compressed_original":74743808,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25530368,"data_stored":51060736,"data_compressed":2635899,"data_compressed_allocated":25530368,"data_compressed_original":51060736,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41992192,"data_stored":83984384,"data_compressed":4335550,"data_compressed_allocated":41992192,"data_compressed_original":83984384,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:12:18.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 36 16 11535 11519 2.49958 2.23438 0.0486535 0.0499615 2024-09-22T03:12:19.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 37 16 11825 11809 2.49325 2.26562 0.0963619 0.0500916 2024-09-22T03:12:20.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:20.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 38 16 12141 12125 2.4926 2.46875 0.0745549 0.050094 2024-09-22T03:12:20.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:20.575+0000 7fcd34f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:20.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:20.580+0000 7fcd34f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:21.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 39 16 12423 12407 2.48517 2.20312 0.0695219 0.050248 2024-09-22T03:12:22.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:12:22.512690+0000 min lat: 0.00893235 max lat: 0.149088 avg lat: 0.0503778 2024-09-22T03:12:22.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:12:22.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 40 16 12711 12695 2.47929 2.25 0.0230378 0.0503778 2024-09-22T03:12:22.723 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:22.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:22.834+0000 7ff1d60d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:22.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:22.839+0000 7ff1d60d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:23.458 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:12:23.458 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:12:23.458 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:12:23.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:12:23.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 41 16 13011 12995 2.47598 2.34375 0.0543185 0.0504463 2024-09-22T03:12:23.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:23.583+0000 7f729946c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:23.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:23.591+0000 7f729946c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:23.610 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:23.611 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:23.611 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:12:23.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:23.734+0000 7f9edcab2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:23.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:23.744+0000 7f9edcab2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:23.770 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:23.771 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:23.771 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:12:23.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:23.901+0000 7f8ce4d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:23.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:23.913+0000 7f8ce4d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:23.933 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:23.934 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:23.934 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:23.934 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:23.934 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:23.934 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:23.934 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:23.934 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:23.934 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:23.934 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:23.934 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:23.934 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:23.937 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:23.938 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:23.938 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:12:24.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:24.052+0000 7f55b2397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:24.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:24.061+0000 7f55b2397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:24.164 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:24.164 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:24.164 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:24.166 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:24.166 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:24.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 42 16 13265 13249 2.46427 1.98438 0.0633904 0.0506861 2024-09-22T03:12:25.009 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:25.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:25.135+0000 7fbf7a66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:25.142+0000 7fbf7a66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:25.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 43 16 13551 13535 2.45892 2.23438 0.0329614 0.0508095 2024-09-22T03:12:26.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 44 16 13844 13828 2.45505 2.28906 0.038254 0.0508799 2024-09-22T03:12:27.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:27.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:27.479+0000 7fd3ff957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:27.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:27.485+0000 7fd3ff957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:27.513 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 45 16 14133 14117 2.45067 2.25781 0.0402333 0.0509648 2024-09-22T03:12:28.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 46 16 14402 14386 2.44307 2.10156 0.0204093 0.0510944 2024-09-22T03:12:29.168 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:12:29.168 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:12:29.168 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:12:29.168 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:12:29.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:29.313+0000 7fc87e317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:29.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:29.322+0000 7fc87e317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:29.344 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:29.344 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:29.344 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:29.344 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:29.344 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:29.345 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:29.345 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:29.345 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:29.345 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:29.345 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:29.345 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:29.345 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:29.348 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:29.349 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:29.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:12:29.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:29.486+0000 7fa80ba6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:29.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:29.500+0000 7fa80ba6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:29.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 47 16 14668 14652 2.4353 2.07812 0.0298464 0.0512926 2024-09-22T03:12:29.634 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:29.634 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:29.634 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:29.634 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:29.634 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:29.634 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:29.634 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:29.634 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:29.634 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:29.634 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:29.635 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:29.635 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:29.637 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:29.638 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:29.638 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:12:29.698 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:29.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:29.788+0000 7f9256917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:29.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:29.805+0000 7f9256917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:29.829 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:29.829 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:29.829 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:29.829 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:29.829 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:29.830 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:29.830 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:29.830 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:29.830 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:29.830 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:29.830 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:29.830 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:29.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:29.827+0000 7fb813997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:29.832 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:29.833 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:29.833 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:12:29.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:29.834+0000 7fb813997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:29.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:29.980+0000 7f06dbf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:29.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:29.991+0000 7f06dbf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:30.085 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:30.085 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:30.085 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:30.086 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:30.086 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:30.086 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:30.086 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:30.086 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:30.086 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:30.086 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:30.086 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:30.086 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:30.090 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:30.090 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:30.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 48 16 14925 14909 2.4264 2.00781 0.113925 0.0514539 2024-09-22T03:12:31.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 49 16 15200 15184 2.42072 2.14844 0.0331467 0.0516114 2024-09-22T03:12:32.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:32.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:32.246+0000 7f1cb7197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:32.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:32.252+0000 7f1cb7197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:32.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 50 16 15478 15462 2.41574 2.17188 0.0611866 0.0517074 2024-09-22T03:12:33.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 51 16 15757 15741 2.41111 2.17969 0.0282904 0.0518168 2024-09-22T03:12:34.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:34.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 52 16 16020 16004 2.40425 2.05469 0.0689694 0.0519443 2024-09-22T03:12:34.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:34.640+0000 7ff59c46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:34.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:34.646+0000 7ff59c46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:35.090 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:12:35.091 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:12:35.091 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:12:35.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:12:35.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:35.202+0000 7f2eb1c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:35.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:35.213+0000 7f2eb1c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:35.238 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:35.238 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:35.238 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:35.238 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:35.238 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:35.238 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:35.238 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:35.238 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:35.238 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:35.238 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:35.239 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:35.239 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:35.241 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:35.241 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:35.241 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:12:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:35.365+0000 7f185f157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:35.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:35.375+0000 7f185f157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:35.492 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:35.492 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:35.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:12:35.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 53 16 16283 16267 2.39765 2.05469 0.0701832 0.0520788 2024-09-22T03:12:35.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:35.632+0000 7f8479cce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:35.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:35.643+0000 7f8479cce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:35.690 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:35.690 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:35.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:12:35.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:35.875+0000 7ff0bf397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:35.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:35.888+0000 7ff0bf397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:35.945 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:12:35.945 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:12:35.945 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:12:35.945 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:12:35.945 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:12:35.945 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:12:35.945 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:12:35.945 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:12:35.945 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:12:35.945 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:12:35.945 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:12:35.946 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:12:35.949 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:12:35.950 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:12:36.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 54 16 16546 16530 2.3913 2.05469 0.0538703 0.052238 2024-09-22T03:12:36.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:37.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:37.067+0000 7f03c3a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:37.074+0000 7f03c3a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:37.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 55 16 16807 16791 2.38489 2.03906 0.0668003 0.0523767 2024-09-22T03:12:38.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 56 16 17054 17038 2.37676 1.92969 0.0440574 0.0525485 2024-09-22T03:12:39.264 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:39.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:39.402+0000 7fc312d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:39.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:39.409+0000 7fc312d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:39.514 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 57 16 17306 17290 2.3696 1.96875 0.0700037 0.0527206 2024-09-22T03:12:40.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 58 16 17563 17547 2.36336 2.00781 0.0726161 0.0528548 2024-09-22T03:12:40.950 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:12:40.951 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:12:40.951 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:12:41.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:41.059+0000 7f17ece2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:41.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:41.068+0000 7f17ece2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:41.296 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:12:41.296 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:12:41.314 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-22T03:12:40.779332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137159219,"num_objects":2089,"num_object_clones":0,"num_object_copies":6267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":16810,"num_write_kb":135264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16755,"ondisk_log_size":16755,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":371440,"kb_used_data":202348,"kb_used_omap":0,"kb_used_meta":169024,"kb_avail":377115920,"statfs":{"total":386547056640,"available":386166702080,"internally_reserved":0,"allocated":207204352,"data_stored":412960717,"data_compressed":21286884,"data_compressed_allocated":205410304,"data_compressed_original":412295168,"omap_allocated":0,"internal_metadata":173080576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22847488,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2789,"num_write_kb":22312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001908"},"pg_stats":[{"pgid":"7.f","version":"50'1015","reported_seq":1028,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.390257+0000","last_change":"2024-09-22T03:11:41.549868+0000","last_active":"2024-09-22T03:12:36.390257+0000","last_peered":"2024-09-22T03:12:36.390257+0000","last_clean":"2024-09-22T03:12:36.390257+0000","last_became_active":"2024-09-22T03:11:41.545171+0000","last_became_peered":"2024-09-22T03:11:41.545171+0000","last_unstale":"2024-09-22T03:12:36.390257+0000","last_undegraded":"2024-09-22T03:12:36.390257+0000","last_fullsized":"2024-09-22T03:12:36.390257+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1016,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"50'1119","reported_seq":1132,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.392409+0000","last_change":"2024-09-22T03:11:41.496023+0000","last_active":"2024-09-22T03:12:36.392409+0000","last_peered":"2024-09-22T03:12:36.392409+0000","last_clean":"2024-09-22T03:12:36.392409+0000","last_became_active":"2024-09-22T03:11:41.492941+0000","last_became_peered":"2024-09-22T03:11:41.492941+0000","last_unstale":"2024-09-22T03:12:36.392409+0000","last_undegraded":"2024-09-22T03:12:36.392409+0000","last_fullsized":"2024-09-22T03:12:36.392409+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"50'1167","reported_seq":1180,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.631951+0000","last_change":"2024-09-22T03:11:41.523699+0000","last_active":"2024-09-22T03:12:36.631951+0000","last_peered":"2024-09-22T03:12:36.631951+0000","last_clean":"2024-09-22T03:12:36.631951+0000","last_became_active":"2024-09-22T03:11:41.520422+0000","last_became_peered":"2024-09-22T03:11:41.520422+0000","last_unstale":"2024-09-22T03:12:36.631951+0000","last_undegraded":"2024-09-22T03:12:36.631951+0000","last_fullsized":"2024-09-22T03:12:36.631951+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1167,"log_dups_size":0,"ondisk_log_size":1167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"50'1041","reported_seq":1054,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.736255+0000","last_change":"2024-09-22T03:11:41.513541+0000","last_active":"2024-09-22T03:12:36.736255+0000","last_peered":"2024-09-22T03:12:36.736255+0000","last_clean":"2024-09-22T03:12:36.736255+0000","last_became_active":"2024-09-22T03:11:41.509909+0000","last_became_peered":"2024-09-22T03:11:41.509909+0000","last_unstale":"2024-09-22T03:12:36.736255+0000","last_undegraded":"2024-09-22T03:12:36.736255+0000","last_fullsized":"2024-09-22T03:12:36.736255+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1041,"log_dups_size":0,"ondisk_log_size":1041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8536064,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":8336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'1023","reported_seq":1036,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:35.925297+0000","last_change":"2024-09-22T03:11:41.518404+0000","last_active":"2024-09-22T03:12:35.925297+0000","last_peered":"2024-09-22T03:12:35.925297+0000","last_clean":"2024-09-22T03:12:35.925297+0000","last_became_active":"2024-09-22T03:11:41.513810+0000","last_became_peered":"2024-09-22T03:11:41.513810+0000","last_unstale":"2024-09-22T03:12:35.925297+0000","last_undegraded":"2024-09-22T03:12:35.925297+0000","last_fullsized":"2024-09-22T03:12:35.925297+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"50'1031","reported_seq":1044,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.438641+0000","last_change":"2024-09-22T03:11:41.507457+0000","last_active":"2024-09-22T03:12:36.438641+0000","last_peered":"2024-09-22T03:12:36.438641+0000","last_clean":"2024-09-22T03:12:36.438641+0000","last_became_active":"2024-09-22T03:11:41.496687+0000","last_became_peered":"2024-09-22T03:11:41.496687+0000","last_unstale":"2024-09-22T03:12:36.438641+0000","last_undegraded":"2024-09-22T03:12:36.438641+0000","last_fullsized":"2024-09-22T03:12:36.438641+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"50'1039","reported_seq":1052,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.473885+0000","last_change":"2024-09-22T03:11:41.548004+0000","last_active":"2024-09-22T03:12:36.473885+0000","last_peered":"2024-09-22T03:12:36.473885+0000","last_clean":"2024-09-22T03:12:36.473885+0000","last_became_active":"2024-09-22T03:11:41.541878+0000","last_became_peered":"2024-09-22T03:11:41.541878+0000","last_unstale":"2024-09-22T03:12:36.473885+0000","last_undegraded":"2024-09-22T03:12:36.473885+0000","last_fullsized":"2024-09-22T03:12:36.473885+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"50'943","reported_seq":956,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.545051+0000","last_change":"2024-09-22T03:11:41.507878+0000","last_active":"2024-09-22T03:12:36.545051+0000","last_peered":"2024-09-22T03:12:36.545051+0000","last_clean":"2024-09-22T03:12:36.545051+0000","last_became_active":"2024-09-22T03:11:41.502557+0000","last_became_peered":"2024-09-22T03:11:41.502557+0000","last_unstale":"2024-09-22T03:12:36.545051+0000","last_undegraded":"2024-09-22T03:12:36.545051+0000","last_fullsized":"2024-09-22T03:12:36.545051+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"50'1006","reported_seq":1019,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.760093+0000","last_change":"2024-09-22T03:11:41.551304+0000","last_active":"2024-09-22T03:12:36.760093+0000","last_peered":"2024-09-22T03:12:36.760093+0000","last_clean":"2024-09-22T03:12:36.760093+0000","last_became_active":"2024-09-22T03:11:41.543833+0000","last_became_peered":"2024-09-22T03:11:41.543833+0000","last_unstale":"2024-09-22T03:12:36.760093+0000","last_undegraded":"2024-09-22T03:12:36.760093+0000","last_fullsized":"2024-09-22T03:12:36.760093+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1006,"log_dups_size":0,"ondisk_log_size":1006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8249344,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1007,"num_write_kb":8056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.436288+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:11:42.436288+0000","last_peered":"2024-09-22T03:11:42.436288+0000","last_clean":"2024-09-22T03:11:42.436288+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:11:42.436288+0000","last_undegraded":"2024-09-22T03:11:42.436288+0000","last_fullsized":"2024-09-22T03:11:42.436288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"50'1207","reported_seq":1220,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:35.584230+0000","last_change":"2024-09-22T03:11:41.524387+0000","last_active":"2024-09-22T03:12:35.584230+0000","last_peered":"2024-09-22T03:12:35.584230+0000","last_clean":"2024-09-22T03:12:35.584230+0000","last_became_active":"2024-09-22T03:11:41.517799+0000","last_became_peered":"2024-09-22T03:11:41.517799+0000","last_unstale":"2024-09-22T03:12:35.584230+0000","last_undegraded":"2024-09-22T03:12:35.584230+0000","last_fullsized":"2024-09-22T03:12:35.584230+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1207,"log_dups_size":0,"ondisk_log_size":1207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437908+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:11:42.437908+0000","last_peered":"2024-09-22T03:11:42.437908+0000","last_clean":"2024-09-22T03:11:42.437908+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:11:42.437908+0000","last_undegraded":"2024-09-22T03:11:42.437908+0000","last_fullsized":"2024-09-22T03:11:42.437908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"50'943","reported_seq":956,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.533192+0000","last_change":"2024-09-22T03:11:41.577187+0000","last_active":"2024-09-22T03:12:36.533192+0000","last_peered":"2024-09-22T03:12:36.533192+0000","last_clean":"2024-09-22T03:12:36.533192+0000","last_became_active":"2024-09-22T03:11:41.553906+0000","last_became_peered":"2024-09-22T03:11:41.553906+0000","last_unstale":"2024-09-22T03:12:36.533192+0000","last_undegraded":"2024-09-22T03:12:36.533192+0000","last_fullsized":"2024-09-22T03:12:36.533192+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":126,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.433377+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:11:42.433377+0000","last_peered":"2024-09-22T03:11:42.433377+0000","last_clean":"2024-09-22T03:11:42.433377+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:11:42.433377+0000","last_undegraded":"2024-09-22T03:11:42.433377+0000","last_fullsized":"2024-09-22T03:11:42.433377+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"50'1087","reported_seq":1100,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.655008+0000","last_change":"2024-09-22T03:11:41.534290+0000","last_active":"2024-09-22T03:12:36.655008+0000","last_peered":"2024-09-22T03:12:36.655008+0000","last_clean":"2024-09-22T03:12:36.655008+0000","last_became_active":"2024-09-22T03:11:41.529404+0000","last_became_peered":"2024-09-22T03:11:41.529404+0000","last_unstale":"2024-09-22T03:12:36.655008+0000","last_undegraded":"2024-09-22T03:12:36.655008+0000","last_fullsized":"2024-09-22T03:12:36.655008+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1087,"log_dups_size":0,"ondisk_log_size":1087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912896,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1088,"num_write_kb":8704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":125,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437423+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:11:42.437423+0000","last_peered":"2024-09-22T03:11:42.437423+0000","last_clean":"2024-09-22T03:11:42.437423+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:11:42.437423+0000","last_undegraded":"2024-09-22T03:11:42.437423+0000","last_fullsized":"2024-09-22T03:11:42.437423+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441374+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:11:42.441374+0000","last_peered":"2024-09-22T03:11:42.441374+0000","last_clean":"2024-09-22T03:11:42.441374+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:11:42.441374+0000","last_undegraded":"2024-09-22T03:11:42.441374+0000","last_fullsized":"2024-09-22T03:11:42.441374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"50'1007","reported_seq":1020,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.701577+0000","last_change":"2024-09-22T03:11:41.531581+0000","last_active":"2024-09-22T03:12:36.701577+0000","last_peered":"2024-09-22T03:12:36.701577+0000","last_clean":"2024-09-22T03:12:36.701577+0000","last_became_active":"2024-09-22T03:11:41.525831+0000","last_became_peered":"2024-09-22T03:11:41.525831+0000","last_unstale":"2024-09-22T03:12:36.701577+0000","last_undegraded":"2024-09-22T03:12:36.701577+0000","last_fullsized":"2024-09-22T03:12:36.701577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1008,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.439011+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:11:42.439011+0000","last_peered":"2024-09-22T03:11:42.439011+0000","last_clean":"2024-09-22T03:11:42.439011+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:11:42.439011+0000","last_undegraded":"2024-09-22T03:11:42.439011+0000","last_fullsized":"2024-09-22T03:11:42.439011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"50'887","reported_seq":900,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.746825+0000","last_change":"2024-09-22T03:11:41.533626+0000","last_active":"2024-09-22T03:12:36.746825+0000","last_peered":"2024-09-22T03:12:36.746825+0000","last_clean":"2024-09-22T03:12:36.746825+0000","last_became_active":"2024-09-22T03:11:41.527097+0000","last_became_peered":"2024-09-22T03:11:41.527097+0000","last_unstale":"2024-09-22T03:12:36.746825+0000","last_undegraded":"2024-09-22T03:12:36.746825+0000","last_fullsized":"2024-09-22T03:12:36.746825+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.438284+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:11:42.438284+0000","last_peered":"2024-09-22T03:11:42.438284+0000","last_clean":"2024-09-22T03:11:42.438284+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:11:42.438284+0000","last_undegraded":"2024-09-22T03:11:42.438284+0000","last_fullsized":"2024-09-22T03:11:42.438284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"50'1103","reported_seq":1116,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:36.517955+0000","last_change":"2024-09-22T03:11:41.522320+0000","last_active":"2024-09-22T03:12:36.517955+0000","last_peered":"2024-09-22T03:12:36.517955+0000","last_clean":"2024-09-22T03:12:36.517955+0000","last_became_active":"2024-09-22T03:11:41.514872+0000","last_became_peered":"2024-09-22T03:11:41.514872+0000","last_unstale":"2024-09-22T03:12:36.517955+0000","last_undegraded":"2024-09-22T03:12:36.517955+0000","last_fullsized":"2024-09-22T03:12:36.517955+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1103,"log_dups_size":0,"ondisk_log_size":1103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1104,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.442945+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:11:42.442945+0000","last_peered":"2024-09-22T03:11:42.442945+0000","last_clean":"2024-09-22T03:11:42.442945+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:11:42.442945+0000","last_undegraded":"2024-09-22T03:11:42.442945+0000","last_fullsized":"2024-09-22T03:11:42.442945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"50'1037","reported_seq":1050,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:40.748831+0000","last_change":"2024-09-22T03:11:41.514921+0000","last_active":"2024-09-22T03:12:40.748831+0000","last_peered":"2024-09-22T03:12:40.748831+0000","last_clean":"2024-09-22T03:12:40.748831+0000","last_became_active":"2024-09-22T03:11:41.509520+0000","last_became_peered":"2024-09-22T03:11:41.509520+0000","last_unstale":"2024-09-22T03:12:40.748831+0000","last_undegraded":"2024-09-22T03:12:40.748831+0000","last_fullsized":"2024-09-22T03:12:40.748831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8503296,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441783+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:11:42.441783+0000","last_peered":"2024-09-22T03:11:42.441783+0000","last_clean":"2024-09-22T03:11:42.441783+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:11:42.441783+0000","last_undegraded":"2024-09-22T03:11:42.441783+0000","last_fullsized":"2024-09-22T03:11:42.441783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":136568832,"num_objects":2085,"num_object_clones":0,"num_object_copies":6255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16671,"num_write_kb":133368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":207044608,"data_stored":414089216,"data_compressed":21378471,"data_compressed_allocated":207044608,"data_compressed_original":414089216,"omap_allocated":0,"internal_metadata":0},"log_size":16655,"ondisk_log_size":16655,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121472,"kb_used_data":61868,"kb_used_omap":0,"kb_used_meta":59584,"kb_avail":94250368,"statfs":{"total":96636764160,"available":96512376832,"internally_reserved":0,"allocated":63352832,"data_stored":125991008,"data_compressed":6496657,"data_compressed_allocated":62918656,"data_compressed_original":125837312,"omap_allocated":0,"internal_metadata":61014016},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78868,"kb_used_data":37892,"kb_used_omap":0,"kb_used_meta":40960,"kb_avail":94292972,"statfs":{"total":96636764160,"available":96556003328,"internally_reserved":0,"allocated":38801408,"data_stored":77355648,"data_compressed":3985195,"data_compressed_allocated":38346752,"data_compressed_original":77185024,"omap_allocated":0,"internal_metadata":41943040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91372,"kb_used_data":55004,"kb_used_omap":0,"kb_used_meta":36352,"kb_avail":94280468,"statfs":{"total":96636764160,"available":96543199232,"internally_reserved":0,"allocated":56324096,"data_stored":112401024,"data_compressed":5794539,"data_compressed_allocated":55869440,"data_compressed_original":112230400,"omap_allocated":0,"internal_metadata":37224448},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79728,"kb_used_data":47584,"kb_used_omap":0,"kb_used_meta":32128,"kb_avail":94292112,"statfs":{"total":96636764160,"available":96555122688,"internally_reserved":0,"allocated":48726016,"data_stored":97213037,"data_compressed":5010493,"data_compressed_allocated":48275456,"data_compressed_original":97042432,"omap_allocated":0,"internal_metadata":32899072},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":48717824,"data_stored":97435648,"data_compressed":5030447,"data_compressed_allocated":48717824,"data_compressed_original":97435648,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":56283136,"data_stored":112566272,"data_compressed":5811532,"data_compressed_allocated":56283136,"data_compressed_original":112566272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38600704,"data_stored":77201408,"data_compressed":3985691,"data_compressed_allocated":38600704,"data_compressed_original":77201408,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":63442944,"data_stored":126885888,"data_compressed":6550801,"data_compressed_allocated":63442944,"data_compressed_original":126885888,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:12:41.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 59 16 17839 17823 2.35984 2.15625 0.066483 0.0529313 2024-09-22T03:12:41.792 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:41.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:41.918+0000 7fdac004f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:41.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:41.925+0000 7fdac004f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:42.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:12:42.514255+0000 min lat: 0.00893235 max lat: 0.182848 avg lat: 0.0530515 2024-09-22T03:12:42.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:12:42.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 60 16 18100 18084 2.3545 2.03906 0.0772915 0.0530515 2024-09-22T03:12:43.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 61 16 18360 18344 2.34919 2.03125 0.0417287 0.0531756 2024-09-22T03:12:44.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:44.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:44.321+0000 7f0b7cd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:44.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:44.326+0000 7f0b7cd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:44.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 62 16 18599 18583 2.34142 1.86719 0.017379 0.0533558 2024-09-22T03:12:45.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 63 16 18832 18816 2.33314 1.82031 0.0333563 0.053539 2024-09-22T03:12:46.316 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:12:46.317 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:12:46.317 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:12:46.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:46.433+0000 7f735f4b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:46.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:46.441+0000 7f735f4b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:46.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 64 16 19079 19063 2.32684 1.92969 0.119682 0.05366 2024-09-22T03:12:46.551 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:46.635 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:12:46.636 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:12:46.655 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-09-22T03:12:44.780000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":147178035,"num_objects":2242,"num_object_clones":0,"num_object_copies":6726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":18033,"num_write_kb":145048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17978,"ondisk_log_size":17978,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":374928,"kb_used_data":214160,"kb_used_omap":0,"kb_used_meta":160704,"kb_avail":377112432,"statfs":{"total":386547056640,"available":386163130368,"internally_reserved":0,"allocated":219299840,"data_stored":437151693,"data_compressed":22536003,"data_compressed_allocated":217505792,"data_compressed_original":436486144,"omap_allocated":0,"internal_metadata":164560896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21749760,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2655,"num_write_kb":21240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001943"},"pg_stats":[{"pgid":"7.f","version":"50'1175","reported_seq":1188,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.508892+0000","last_change":"2024-09-22T03:11:41.549868+0000","last_active":"2024-09-22T03:12:41.508892+0000","last_peered":"2024-09-22T03:12:41.508892+0000","last_clean":"2024-09-22T03:12:41.508892+0000","last_became_active":"2024-09-22T03:11:41.545171+0000","last_became_peered":"2024-09-22T03:11:41.545171+0000","last_unstale":"2024-09-22T03:12:41.508892+0000","last_undegraded":"2024-09-22T03:12:41.508892+0000","last_fullsized":"2024-09-22T03:12:41.508892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"50'1199","reported_seq":1212,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.630278+0000","last_change":"2024-09-22T03:11:41.496023+0000","last_active":"2024-09-22T03:12:41.630278+0000","last_peered":"2024-09-22T03:12:41.630278+0000","last_clean":"2024-09-22T03:12:41.630278+0000","last_became_active":"2024-09-22T03:11:41.492941+0000","last_became_peered":"2024-09-22T03:11:41.492941+0000","last_unstale":"2024-09-22T03:12:41.630278+0000","last_undegraded":"2024-09-22T03:12:41.630278+0000","last_fullsized":"2024-09-22T03:12:41.630278+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"50'1263","reported_seq":1276,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.361358+0000","last_change":"2024-09-22T03:11:41.523699+0000","last_active":"2024-09-22T03:12:41.361358+0000","last_peered":"2024-09-22T03:12:41.361358+0000","last_clean":"2024-09-22T03:12:41.361358+0000","last_became_active":"2024-09-22T03:11:41.520422+0000","last_became_peered":"2024-09-22T03:11:41.520422+0000","last_unstale":"2024-09-22T03:12:41.361358+0000","last_undegraded":"2024-09-22T03:12:41.361358+0000","last_fullsized":"2024-09-22T03:12:41.361358+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1263,"log_dups_size":0,"ondisk_log_size":1263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1264,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"50'1135","reported_seq":1148,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.055076+0000","last_change":"2024-09-22T03:11:41.513541+0000","last_active":"2024-09-22T03:12:41.055076+0000","last_peered":"2024-09-22T03:12:41.055076+0000","last_clean":"2024-09-22T03:12:41.055076+0000","last_became_active":"2024-09-22T03:11:41.509909+0000","last_became_peered":"2024-09-22T03:11:41.509909+0000","last_unstale":"2024-09-22T03:12:41.055076+0000","last_undegraded":"2024-09-22T03:12:41.055076+0000","last_fullsized":"2024-09-22T03:12:41.055076+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1135,"log_dups_size":0,"ondisk_log_size":1135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'1103","reported_seq":1116,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.549418+0000","last_change":"2024-09-22T03:11:41.518404+0000","last_active":"2024-09-22T03:12:41.549418+0000","last_peered":"2024-09-22T03:12:41.549418+0000","last_clean":"2024-09-22T03:12:41.549418+0000","last_became_active":"2024-09-22T03:11:41.513810+0000","last_became_peered":"2024-09-22T03:11:41.513810+0000","last_unstale":"2024-09-22T03:12:41.549418+0000","last_undegraded":"2024-09-22T03:12:41.549418+0000","last_fullsized":"2024-09-22T03:12:41.549418+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1103,"log_dups_size":0,"ondisk_log_size":1103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1104,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"50'1119","reported_seq":1132,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.726641+0000","last_change":"2024-09-22T03:11:41.507457+0000","last_active":"2024-09-22T03:12:41.726641+0000","last_peered":"2024-09-22T03:12:41.726641+0000","last_clean":"2024-09-22T03:12:41.726641+0000","last_became_active":"2024-09-22T03:11:41.496687+0000","last_became_peered":"2024-09-22T03:11:41.496687+0000","last_unstale":"2024-09-22T03:12:41.726641+0000","last_undegraded":"2024-09-22T03:12:41.726641+0000","last_fullsized":"2024-09-22T03:12:41.726641+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"50'1095","reported_seq":1108,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.695432+0000","last_change":"2024-09-22T03:11:41.548004+0000","last_active":"2024-09-22T03:12:41.695432+0000","last_peered":"2024-09-22T03:12:41.695432+0000","last_clean":"2024-09-22T03:12:41.695432+0000","last_became_active":"2024-09-22T03:11:41.541878+0000","last_became_peered":"2024-09-22T03:11:41.541878+0000","last_unstale":"2024-09-22T03:12:41.695432+0000","last_undegraded":"2024-09-22T03:12:41.695432+0000","last_fullsized":"2024-09-22T03:12:41.695432+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1096,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"50'1018","reported_seq":1031,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.743605+0000","last_change":"2024-09-22T03:11:41.507878+0000","last_active":"2024-09-22T03:12:41.743605+0000","last_peered":"2024-09-22T03:12:41.743605+0000","last_clean":"2024-09-22T03:12:41.743605+0000","last_became_active":"2024-09-22T03:11:41.502557+0000","last_became_peered":"2024-09-22T03:11:41.502557+0000","last_unstale":"2024-09-22T03:12:41.743605+0000","last_undegraded":"2024-09-22T03:12:41.743605+0000","last_fullsized":"2024-09-22T03:12:41.743605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8347648,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":8152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"50'1071","reported_seq":1084,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.441456+0000","last_change":"2024-09-22T03:11:41.551304+0000","last_active":"2024-09-22T03:12:41.441456+0000","last_peered":"2024-09-22T03:12:41.441456+0000","last_clean":"2024-09-22T03:12:41.441456+0000","last_became_active":"2024-09-22T03:11:41.543833+0000","last_became_peered":"2024-09-22T03:11:41.543833+0000","last_unstale":"2024-09-22T03:12:41.441456+0000","last_undegraded":"2024-09-22T03:12:41.441456+0000","last_fullsized":"2024-09-22T03:12:41.441456+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.436288+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:11:42.436288+0000","last_peered":"2024-09-22T03:11:42.436288+0000","last_clean":"2024-09-22T03:11:42.436288+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:11:42.436288+0000","last_undegraded":"2024-09-22T03:11:42.436288+0000","last_fullsized":"2024-09-22T03:11:42.436288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"50'1287","reported_seq":1300,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.603365+0000","last_change":"2024-09-22T03:11:41.524387+0000","last_active":"2024-09-22T03:12:41.603365+0000","last_peered":"2024-09-22T03:12:41.603365+0000","last_clean":"2024-09-22T03:12:41.603365+0000","last_became_active":"2024-09-22T03:11:41.517799+0000","last_became_peered":"2024-09-22T03:11:41.517799+0000","last_unstale":"2024-09-22T03:12:41.603365+0000","last_undegraded":"2024-09-22T03:12:41.603365+0000","last_fullsized":"2024-09-22T03:12:41.603365+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1287,"log_dups_size":0,"ondisk_log_size":1287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437908+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:11:42.437908+0000","last_peered":"2024-09-22T03:11:42.437908+0000","last_clean":"2024-09-22T03:11:42.437908+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:11:42.437908+0000","last_undegraded":"2024-09-22T03:11:42.437908+0000","last_fullsized":"2024-09-22T03:11:42.437908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"50'1023","reported_seq":1036,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:40.882043+0000","last_change":"2024-09-22T03:11:41.577187+0000","last_active":"2024-09-22T03:12:40.882043+0000","last_peered":"2024-09-22T03:12:40.882043+0000","last_clean":"2024-09-22T03:12:40.882043+0000","last_became_active":"2024-09-22T03:11:41.553906+0000","last_became_peered":"2024-09-22T03:11:41.553906+0000","last_unstale":"2024-09-22T03:12:40.882043+0000","last_undegraded":"2024-09-22T03:12:40.882043+0000","last_fullsized":"2024-09-22T03:12:40.882043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":126,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.433377+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:11:42.433377+0000","last_peered":"2024-09-22T03:11:42.433377+0000","last_clean":"2024-09-22T03:11:42.433377+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:11:42.433377+0000","last_undegraded":"2024-09-22T03:11:42.433377+0000","last_fullsized":"2024-09-22T03:11:42.433377+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"50'1143","reported_seq":1156,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:40.343068+0000","last_change":"2024-09-22T03:11:41.534290+0000","last_active":"2024-09-22T03:12:40.343068+0000","last_peered":"2024-09-22T03:12:40.343068+0000","last_clean":"2024-09-22T03:12:40.343068+0000","last_became_active":"2024-09-22T03:11:41.529404+0000","last_became_peered":"2024-09-22T03:11:41.529404+0000","last_unstale":"2024-09-22T03:12:40.343068+0000","last_undegraded":"2024-09-22T03:12:40.343068+0000","last_fullsized":"2024-09-22T03:12:40.343068+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":125,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437423+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:11:42.437423+0000","last_peered":"2024-09-22T03:11:42.437423+0000","last_clean":"2024-09-22T03:11:42.437423+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:11:42.437423+0000","last_undegraded":"2024-09-22T03:11:42.437423+0000","last_fullsized":"2024-09-22T03:11:42.437423+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441374+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:11:42.441374+0000","last_peered":"2024-09-22T03:11:42.441374+0000","last_clean":"2024-09-22T03:11:42.441374+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:11:42.441374+0000","last_undegraded":"2024-09-22T03:11:42.441374+0000","last_fullsized":"2024-09-22T03:11:42.441374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"50'1084","reported_seq":1097,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.759002+0000","last_change":"2024-09-22T03:11:41.531581+0000","last_active":"2024-09-22T03:12:41.759002+0000","last_peered":"2024-09-22T03:12:41.759002+0000","last_clean":"2024-09-22T03:12:41.759002+0000","last_became_active":"2024-09-22T03:11:41.525831+0000","last_became_peered":"2024-09-22T03:11:41.525831+0000","last_unstale":"2024-09-22T03:12:41.759002+0000","last_undegraded":"2024-09-22T03:12:41.759002+0000","last_fullsized":"2024-09-22T03:12:41.759002+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1084,"log_dups_size":0,"ondisk_log_size":1084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8888320,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1085,"num_write_kb":8680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.439011+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:11:42.439011+0000","last_peered":"2024-09-22T03:11:42.439011+0000","last_clean":"2024-09-22T03:11:42.439011+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:11:42.439011+0000","last_undegraded":"2024-09-22T03:11:42.439011+0000","last_fullsized":"2024-09-22T03:11:42.439011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"50'935","reported_seq":948,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:40.176892+0000","last_change":"2024-09-22T03:11:41.533626+0000","last_active":"2024-09-22T03:12:40.176892+0000","last_peered":"2024-09-22T03:12:40.176892+0000","last_clean":"2024-09-22T03:12:40.176892+0000","last_became_active":"2024-09-22T03:11:41.527097+0000","last_became_peered":"2024-09-22T03:11:41.527097+0000","last_unstale":"2024-09-22T03:12:40.176892+0000","last_undegraded":"2024-09-22T03:12:40.176892+0000","last_fullsized":"2024-09-22T03:12:40.176892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.438284+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:11:42.438284+0000","last_peered":"2024-09-22T03:11:42.438284+0000","last_clean":"2024-09-22T03:11:42.438284+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:11:42.438284+0000","last_undegraded":"2024-09-22T03:11:42.438284+0000","last_fullsized":"2024-09-22T03:11:42.438284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"50'1191","reported_seq":1204,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:41.643313+0000","last_change":"2024-09-22T03:11:41.522320+0000","last_active":"2024-09-22T03:12:41.643313+0000","last_peered":"2024-09-22T03:12:41.643313+0000","last_clean":"2024-09-22T03:12:41.643313+0000","last_became_active":"2024-09-22T03:11:41.514872+0000","last_became_peered":"2024-09-22T03:11:41.514872+0000","last_unstale":"2024-09-22T03:12:41.643313+0000","last_undegraded":"2024-09-22T03:12:41.643313+0000","last_fullsized":"2024-09-22T03:12:41.643313+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.442945+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:11:42.442945+0000","last_peered":"2024-09-22T03:11:42.442945+0000","last_clean":"2024-09-22T03:11:42.442945+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:11:42.442945+0000","last_undegraded":"2024-09-22T03:11:42.442945+0000","last_fullsized":"2024-09-22T03:11:42.442945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"50'1037","reported_seq":1050,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:40.748831+0000","last_change":"2024-09-22T03:11:41.514921+0000","last_active":"2024-09-22T03:12:40.748831+0000","last_peered":"2024-09-22T03:12:40.748831+0000","last_clean":"2024-09-22T03:12:40.748831+0000","last_became_active":"2024-09-22T03:11:41.509520+0000","last_became_peered":"2024-09-22T03:11:41.509520+0000","last_unstale":"2024-09-22T03:12:40.748831+0000","last_undegraded":"2024-09-22T03:12:40.748831+0000","last_fullsized":"2024-09-22T03:12:40.748831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8503296,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441783+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:11:42.441783+0000","last_peered":"2024-09-22T03:11:42.441783+0000","last_clean":"2024-09-22T03:11:42.441783+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:11:42.441783+0000","last_undegraded":"2024-09-22T03:11:42.441783+0000","last_fullsized":"2024-09-22T03:11:42.441783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":146587648,"num_objects":2238,"num_object_clones":0,"num_object_copies":6714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17894,"num_write_kb":143152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":219205632,"data_stored":438411264,"data_compressed":22634358,"data_compressed_allocated":219205632,"data_compressed_original":438411264,"omap_allocated":0,"internal_metadata":0},"log_size":17878,"ondisk_log_size":17878,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113880,"kb_used_data":66760,"kb_used_omap":0,"kb_used_meta":47104,"kb_avail":94257960,"statfs":{"total":96636764160,"available":96520151040,"internally_reserved":0,"allocated":68362240,"data_stored":136009824,"data_compressed":7013986,"data_compressed_allocated":67928064,"data_compressed_original":135856128,"omap_allocated":0,"internal_metadata":48234496},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81624,"kb_used_data":40648,"kb_used_omap":0,"kb_used_meta":40960,"kb_avail":94290216,"statfs":{"total":96636764160,"available":96553181184,"internally_reserved":0,"allocated":41623552,"data_stored":82999936,"data_compressed":4276642,"data_compressed_allocated":41168896,"data_compressed_original":82829312,"omap_allocated":0,"internal_metadata":41943040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99696,"kb_used_data":59168,"kb_used_omap":0,"kb_used_meta":40512,"kb_avail":94272144,"statfs":{"total":96636764160,"available":96534675456,"internally_reserved":0,"allocated":60588032,"data_stored":120928896,"data_compressed":6234882,"data_compressed_allocated":60133376,"data_compressed_original":120758272,"omap_allocated":0,"internal_metadata":41484288},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79728,"kb_used_data":47584,"kb_used_omap":0,"kb_used_meta":32128,"kb_avail":94292112,"statfs":{"total":96636764160,"available":96555122688,"internally_reserved":0,"allocated":48726016,"data_stored":97213037,"data_compressed":5010493,"data_compressed_allocated":48275456,"data_compressed_original":97042432,"omap_allocated":0,"internal_metadata":32899072},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":48717824,"data_stored":97435648,"data_compressed":5030447,"data_compressed_allocated":48717824,"data_compressed_original":97435648,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60674048,"data_stored":121348096,"data_compressed":6264988,"data_compressed_allocated":60674048,"data_compressed_original":121348096,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41418752,"data_stored":82837504,"data_compressed":4276715,"data_compressed_allocated":41418752,"data_compressed_original":82837504,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":68395008,"data_stored":136790016,"data_compressed":7062208,"data_compressed_allocated":68395008,"data_compressed_original":136790016,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:12:46.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:46.683+0000 7f396caba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:46.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:46.690+0000 7f396caba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:47.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 65 16 19337 19321 2.32205 2.01562 0.0732374 0.0537875 2024-09-22T03:12:48.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 66 16 19591 19575 2.31693 1.98438 0.100479 0.0538944 2024-09-22T03:12:48.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:48.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:48.961+0000 7fcbef997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:48.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:48.967+0000 7fcbef997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:49.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 67 16 19853 19837 2.31289 2.04688 0.0410595 0.0539991 2024-09-22T03:12:50.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 68 16 20121 20105 2.30967 2.09375 0.0634849 0.0540896 2024-09-22T03:12:51.287 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:51.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:51.402+0000 7ff09626c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:51.407+0000 7ff09626c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:51.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 69 16 20381 20365 2.30563 2.03125 0.0691464 0.054183 2024-09-22T03:12:51.657 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:12:51.657 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:12:51.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:12:51.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:51.780+0000 7fa707f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:51.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:51.787+0000 7fa707f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:52.107 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:12:52.108 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:12:52.125 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-09-22T03:12:50.780956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":157942323,"num_objects":2405,"num_object_clones":0,"num_object_copies":7215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":19347,"num_write_kb":155560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19292,"ondisk_log_size":19292,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":385292,"kb_used_data":232844,"kb_used_omap":0,"kb_used_meta":152384,"kb_avail":377102068,"statfs":{"total":386547056640,"available":386152517632,"internally_reserved":0,"allocated":238432256,"data_stored":475416525,"data_compressed":24511836,"data_compressed_allocated":236638208,"data_compressed_original":474750976,"omap_allocated":0,"internal_metadata":156041216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21356544,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2607,"num_write_kb":20856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001930"},"pg_stats":[{"pgid":"7.f","version":"50'1199","reported_seq":1212,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:45.758937+0000","last_change":"2024-09-22T03:11:41.549868+0000","last_active":"2024-09-22T03:12:45.758937+0000","last_peered":"2024-09-22T03:12:45.758937+0000","last_clean":"2024-09-22T03:12:45.758937+0000","last_became_active":"2024-09-22T03:11:41.545171+0000","last_became_peered":"2024-09-22T03:11:41.545171+0000","last_unstale":"2024-09-22T03:12:45.758937+0000","last_undegraded":"2024-09-22T03:12:45.758937+0000","last_fullsized":"2024-09-22T03:12:45.758937+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"50'1215","reported_seq":1228,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:45.640895+0000","last_change":"2024-09-22T03:11:41.496023+0000","last_active":"2024-09-22T03:12:45.640895+0000","last_peered":"2024-09-22T03:12:45.640895+0000","last_clean":"2024-09-22T03:12:45.640895+0000","last_became_active":"2024-09-22T03:11:41.492941+0000","last_became_peered":"2024-09-22T03:11:41.492941+0000","last_unstale":"2024-09-22T03:12:45.640895+0000","last_undegraded":"2024-09-22T03:12:45.640895+0000","last_fullsized":"2024-09-22T03:12:45.640895+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"50'1303","reported_seq":1316,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:46.647655+0000","last_change":"2024-09-22T03:11:41.523699+0000","last_active":"2024-09-22T03:12:46.647655+0000","last_peered":"2024-09-22T03:12:46.647655+0000","last_clean":"2024-09-22T03:12:46.647655+0000","last_became_active":"2024-09-22T03:11:41.520422+0000","last_became_peered":"2024-09-22T03:11:41.520422+0000","last_unstale":"2024-09-22T03:12:46.647655+0000","last_undegraded":"2024-09-22T03:12:46.647655+0000","last_fullsized":"2024-09-22T03:12:46.647655+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"50'1207","reported_seq":1220,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:46.311502+0000","last_change":"2024-09-22T03:11:41.513541+0000","last_active":"2024-09-22T03:12:46.311502+0000","last_peered":"2024-09-22T03:12:46.311502+0000","last_clean":"2024-09-22T03:12:46.311502+0000","last_became_active":"2024-09-22T03:11:41.509909+0000","last_became_peered":"2024-09-22T03:11:41.509909+0000","last_unstale":"2024-09-22T03:12:46.311502+0000","last_undegraded":"2024-09-22T03:12:46.311502+0000","last_fullsized":"2024-09-22T03:12:46.311502+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1207,"log_dups_size":0,"ondisk_log_size":1207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'1183","reported_seq":1196,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:46.609194+0000","last_change":"2024-09-22T03:11:41.518404+0000","last_active":"2024-09-22T03:12:46.609194+0000","last_peered":"2024-09-22T03:12:46.609194+0000","last_clean":"2024-09-22T03:12:46.609194+0000","last_became_active":"2024-09-22T03:11:41.513810+0000","last_became_peered":"2024-09-22T03:11:41.513810+0000","last_unstale":"2024-09-22T03:12:46.609194+0000","last_undegraded":"2024-09-22T03:12:46.609194+0000","last_fullsized":"2024-09-22T03:12:46.609194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1183,"log_dups_size":0,"ondisk_log_size":1183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":9472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"50'1199","reported_seq":1212,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:46.702608+0000","last_change":"2024-09-22T03:11:41.507457+0000","last_active":"2024-09-22T03:12:46.702608+0000","last_peered":"2024-09-22T03:12:46.702608+0000","last_clean":"2024-09-22T03:12:46.702608+0000","last_became_active":"2024-09-22T03:11:41.496687+0000","last_became_peered":"2024-09-22T03:11:41.496687+0000","last_unstale":"2024-09-22T03:12:46.702608+0000","last_undegraded":"2024-09-22T03:12:46.702608+0000","last_fullsized":"2024-09-22T03:12:46.702608+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"50'1191","reported_seq":1204,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:45.728244+0000","last_change":"2024-09-22T03:11:41.548004+0000","last_active":"2024-09-22T03:12:45.728244+0000","last_peered":"2024-09-22T03:12:45.728244+0000","last_clean":"2024-09-22T03:12:45.728244+0000","last_became_active":"2024-09-22T03:11:41.541878+0000","last_became_peered":"2024-09-22T03:11:41.541878+0000","last_unstale":"2024-09-22T03:12:45.728244+0000","last_undegraded":"2024-09-22T03:12:45.728244+0000","last_fullsized":"2024-09-22T03:12:45.728244+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"50'1071","reported_seq":1084,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:46.405073+0000","last_change":"2024-09-22T03:11:41.507878+0000","last_active":"2024-09-22T03:12:46.405073+0000","last_peered":"2024-09-22T03:12:46.405073+0000","last_clean":"2024-09-22T03:12:46.405073+0000","last_became_active":"2024-09-22T03:11:41.502557+0000","last_became_peered":"2024-09-22T03:11:41.502557+0000","last_unstale":"2024-09-22T03:12:46.405073+0000","last_undegraded":"2024-09-22T03:12:46.405073+0000","last_fullsized":"2024-09-22T03:12:46.405073+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"50'1183","reported_seq":1196,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:46.524981+0000","last_change":"2024-09-22T03:11:41.551304+0000","last_active":"2024-09-22T03:12:46.524981+0000","last_peered":"2024-09-22T03:12:46.524981+0000","last_clean":"2024-09-22T03:12:46.524981+0000","last_became_active":"2024-09-22T03:11:41.543833+0000","last_became_peered":"2024-09-22T03:11:41.543833+0000","last_unstale":"2024-09-22T03:12:46.524981+0000","last_undegraded":"2024-09-22T03:12:46.524981+0000","last_fullsized":"2024-09-22T03:12:46.524981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1183,"log_dups_size":0,"ondisk_log_size":1183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":9472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.436288+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:11:42.436288+0000","last_peered":"2024-09-22T03:11:42.436288+0000","last_clean":"2024-09-22T03:11:42.436288+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:11:42.436288+0000","last_undegraded":"2024-09-22T03:11:42.436288+0000","last_fullsized":"2024-09-22T03:11:42.436288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"50'1407","reported_seq":1420,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:46.722828+0000","last_change":"2024-09-22T03:11:41.524387+0000","last_active":"2024-09-22T03:12:46.722828+0000","last_peered":"2024-09-22T03:12:46.722828+0000","last_clean":"2024-09-22T03:12:46.722828+0000","last_became_active":"2024-09-22T03:11:41.517799+0000","last_became_peered":"2024-09-22T03:11:41.517799+0000","last_unstale":"2024-09-22T03:12:46.722828+0000","last_undegraded":"2024-09-22T03:12:46.722828+0000","last_fullsized":"2024-09-22T03:12:46.722828+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437908+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:11:42.437908+0000","last_peered":"2024-09-22T03:11:42.437908+0000","last_clean":"2024-09-22T03:11:42.437908+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:11:42.437908+0000","last_undegraded":"2024-09-22T03:11:42.437908+0000","last_fullsized":"2024-09-22T03:11:42.437908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"50'1071","reported_seq":1084,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:46.177038+0000","last_change":"2024-09-22T03:11:41.577187+0000","last_active":"2024-09-22T03:12:46.177038+0000","last_peered":"2024-09-22T03:12:46.177038+0000","last_clean":"2024-09-22T03:12:46.177038+0000","last_became_active":"2024-09-22T03:11:41.553906+0000","last_became_peered":"2024-09-22T03:11:41.553906+0000","last_unstale":"2024-09-22T03:12:46.177038+0000","last_undegraded":"2024-09-22T03:12:46.177038+0000","last_fullsized":"2024-09-22T03:12:46.177038+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":126,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.433377+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:11:42.433377+0000","last_peered":"2024-09-22T03:11:42.433377+0000","last_clean":"2024-09-22T03:11:42.433377+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:11:42.433377+0000","last_undegraded":"2024-09-22T03:11:42.433377+0000","last_fullsized":"2024-09-22T03:11:42.433377+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"50'1215","reported_seq":1228,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:45.514145+0000","last_change":"2024-09-22T03:11:41.534290+0000","last_active":"2024-09-22T03:12:45.514145+0000","last_peered":"2024-09-22T03:12:45.514145+0000","last_clean":"2024-09-22T03:12:45.514145+0000","last_became_active":"2024-09-22T03:11:41.529404+0000","last_became_peered":"2024-09-22T03:11:41.529404+0000","last_unstale":"2024-09-22T03:12:45.514145+0000","last_undegraded":"2024-09-22T03:12:45.514145+0000","last_fullsized":"2024-09-22T03:12:45.514145+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":125,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437423+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:11:42.437423+0000","last_peered":"2024-09-22T03:11:42.437423+0000","last_clean":"2024-09-22T03:11:42.437423+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:11:42.437423+0000","last_undegraded":"2024-09-22T03:11:42.437423+0000","last_fullsized":"2024-09-22T03:11:42.437423+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441374+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:11:42.441374+0000","last_peered":"2024-09-22T03:11:42.441374+0000","last_clean":"2024-09-22T03:11:42.441374+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:11:42.441374+0000","last_undegraded":"2024-09-22T03:11:42.441374+0000","last_fullsized":"2024-09-22T03:11:42.441374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"50'1207","reported_seq":1220,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:46.759106+0000","last_change":"2024-09-22T03:11:41.531581+0000","last_active":"2024-09-22T03:12:46.759106+0000","last_peered":"2024-09-22T03:12:46.759106+0000","last_clean":"2024-09-22T03:12:46.759106+0000","last_became_active":"2024-09-22T03:11:41.525831+0000","last_became_peered":"2024-09-22T03:11:41.525831+0000","last_unstale":"2024-09-22T03:12:46.759106+0000","last_undegraded":"2024-09-22T03:12:46.759106+0000","last_fullsized":"2024-09-22T03:12:46.759106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1207,"log_dups_size":0,"ondisk_log_size":1207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.439011+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:11:42.439011+0000","last_peered":"2024-09-22T03:11:42.439011+0000","last_clean":"2024-09-22T03:11:42.439011+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:11:42.439011+0000","last_undegraded":"2024-09-22T03:11:42.439011+0000","last_fullsized":"2024-09-22T03:11:42.439011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"50'1039","reported_seq":1052,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:46.623125+0000","last_change":"2024-09-22T03:11:41.533626+0000","last_active":"2024-09-22T03:12:46.623125+0000","last_peered":"2024-09-22T03:12:46.623125+0000","last_clean":"2024-09-22T03:12:46.623125+0000","last_became_active":"2024-09-22T03:11:41.527097+0000","last_became_peered":"2024-09-22T03:11:41.527097+0000","last_unstale":"2024-09-22T03:12:46.623125+0000","last_undegraded":"2024-09-22T03:12:46.623125+0000","last_fullsized":"2024-09-22T03:12:46.623125+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.438284+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:11:42.438284+0000","last_peered":"2024-09-22T03:11:42.438284+0000","last_clean":"2024-09-22T03:11:42.438284+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:11:42.438284+0000","last_undegraded":"2024-09-22T03:11:42.438284+0000","last_fullsized":"2024-09-22T03:11:42.438284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"50'1271","reported_seq":1284,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:46.078796+0000","last_change":"2024-09-22T03:11:41.522320+0000","last_active":"2024-09-22T03:12:46.078796+0000","last_peered":"2024-09-22T03:12:46.078796+0000","last_clean":"2024-09-22T03:12:46.078796+0000","last_became_active":"2024-09-22T03:11:41.514872+0000","last_became_peered":"2024-09-22T03:11:41.514872+0000","last_unstale":"2024-09-22T03:12:46.078796+0000","last_undegraded":"2024-09-22T03:12:46.078796+0000","last_fullsized":"2024-09-22T03:12:46.078796+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.442945+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:11:42.442945+0000","last_peered":"2024-09-22T03:11:42.442945+0000","last_clean":"2024-09-22T03:11:42.442945+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:11:42.442945+0000","last_undegraded":"2024-09-22T03:11:42.442945+0000","last_fullsized":"2024-09-22T03:11:42.442945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"50'1231","reported_seq":1244,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:50.745174+0000","last_change":"2024-09-22T03:11:41.514921+0000","last_active":"2024-09-22T03:12:50.745174+0000","last_peered":"2024-09-22T03:12:50.745174+0000","last_clean":"2024-09-22T03:12:50.745174+0000","last_became_active":"2024-09-22T03:11:41.509520+0000","last_became_peered":"2024-09-22T03:11:41.509520+0000","last_unstale":"2024-09-22T03:12:50.745174+0000","last_undegraded":"2024-09-22T03:12:50.745174+0000","last_fullsized":"2024-09-22T03:12:50.745174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1231,"log_dups_size":0,"ondisk_log_size":1231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":9856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441783+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:11:42.441783+0000","last_peered":"2024-09-22T03:11:42.441783+0000","last_clean":"2024-09-22T03:11:42.441783+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:11:42.441783+0000","last_undegraded":"2024-09-22T03:11:42.441783+0000","last_fullsized":"2024-09-22T03:11:42.441783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":157351936,"num_objects":2401,"num_object_clones":0,"num_object_copies":7203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19208,"num_write_kb":153664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":238002176,"data_stored":476004352,"data_compressed":24575505,"data_compressed_allocated":238002176,"data_compressed_original":476004352,"omap_allocated":0,"internal_metadata":0},"log_size":19192,"ondisk_log_size":19192,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127080,"kb_used_data":71640,"kb_used_omap":0,"kb_used_meta":55424,"kb_avail":94244760,"statfs":{"total":96636764160,"available":96506634240,"internally_reserved":0,"allocated":73359360,"data_stored":146004064,"data_compressed":7530046,"data_compressed_allocated":72925184,"data_compressed_original":145850368,"omap_allocated":0,"internal_metadata":56754176},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71664,"kb_used_data":43168,"kb_used_omap":0,"kb_used_meta":28480,"kb_avail":94300176,"statfs":{"total":96636764160,"available":96563380224,"internally_reserved":0,"allocated":44204032,"data_stored":88160896,"data_compressed":4543132,"data_compressed_allocated":43749376,"data_compressed_original":87990272,"omap_allocated":0,"internal_metadata":29163520},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91436,"kb_used_data":63388,"kb_used_omap":0,"kb_used_meta":28032,"kb_avail":94280404,"statfs":{"total":96636764160,"available":96543133696,"internally_reserved":0,"allocated":64909312,"data_stored":129571456,"data_compressed":6681147,"data_compressed_allocated":64454656,"data_compressed_original":129400832,"omap_allocated":0,"internal_metadata":28704768},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95112,"kb_used_data":54648,"kb_used_omap":0,"kb_used_meta":40448,"kb_avail":94276728,"statfs":{"total":96636764160,"available":96539369472,"internally_reserved":0,"allocated":55959552,"data_stored":111680109,"data_compressed":5757511,"data_compressed_allocated":55508992,"data_compressed_original":111509504,"omap_allocated":0,"internal_metadata":41418752},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":55889920,"data_stored":111779840,"data_compressed":5771120,"data_compressed_allocated":55889920,"data_compressed_original":111779840,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":64802816,"data_stored":129605632,"data_compressed":6691372,"data_compressed_allocated":64802816,"data_compressed_original":129605632,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":43909120,"data_stored":87818240,"data_compressed":4533899,"data_compressed_allocated":43909120,"data_compressed_original":87818240,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73400320,"data_stored":146800640,"data_compressed":7579114,"data_compressed_allocated":73400320,"data_compressed_original":146800640,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:12:52.515 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 70 16 20633 20617 2.30082 1.96875 0.0707174 0.054292 2024-09-22T03:12:53.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 71 16 20898 20882 2.29757 2.07031 0.0582198 0.0543779 2024-09-22T03:12:53.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:53.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:53.792+0000 7f51358c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:53.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:53.802+0000 7f51358c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:54.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 72 15 21146 21131 2.29267 1.94531 0.0526795 0.0544942 2024-09-22T03:12:55.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 73 16 21390 21374 2.28727 1.89844 0.04932 0.0546113 2024-09-22T03:12:56.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:12:56.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:56.259+0000 7f3273ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:56.268+0000 7f3273ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:56.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 74 16 21649 21633 2.2837 2.02344 0.0265679 0.0547055 2024-09-22T03:12:57.126 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:12:57.126 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:12:57.127 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:12:57.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:57.245+0000 7f846fcd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:57.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:57.253+0000 7f846fcd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:57.478 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:12:57.478 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:12:57.491 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-22T03:12:56.781949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":178348595,"num_objects":2717,"num_object_clones":0,"num_object_copies":8151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":21838,"num_write_kb":175488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21783,"ondisk_log_size":21783,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":422148,"kb_used_data":259972,"kb_used_omap":0,"kb_used_meta":162112,"kb_avail":377065212,"statfs":{"total":386547056640,"available":386114777088,"internally_reserved":0,"allocated":266211328,"data_stored":530974669,"data_compressed":27380622,"data_compressed_allocated":264417280,"data_compressed_original":530309120,"omap_allocated":0,"internal_metadata":166002688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31170560,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3805,"num_write_kb":30440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001948"},"pg_stats":[{"pgid":"7.f","version":"50'1330","reported_seq":1343,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.761543+0000","last_change":"2024-09-22T03:11:41.549868+0000","last_active":"2024-09-22T03:12:56.761543+0000","last_peered":"2024-09-22T03:12:56.761543+0000","last_clean":"2024-09-22T03:12:56.761543+0000","last_became_active":"2024-09-22T03:11:41.545171+0000","last_became_peered":"2024-09-22T03:11:41.545171+0000","last_unstale":"2024-09-22T03:12:56.761543+0000","last_undegraded":"2024-09-22T03:12:56.761543+0000","last_fullsized":"2024-09-22T03:12:56.761543+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10903552,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1331,"num_write_kb":10648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"50'1375","reported_seq":1388,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.495900+0000","last_change":"2024-09-22T03:11:41.496023+0000","last_active":"2024-09-22T03:12:56.495900+0000","last_peered":"2024-09-22T03:12:56.495900+0000","last_clean":"2024-09-22T03:12:56.495900+0000","last_became_active":"2024-09-22T03:11:41.492941+0000","last_became_peered":"2024-09-22T03:11:41.492941+0000","last_unstale":"2024-09-22T03:12:56.495900+0000","last_undegraded":"2024-09-22T03:12:56.495900+0000","last_fullsized":"2024-09-22T03:12:56.495900+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1376,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"50'1471","reported_seq":1484,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.364264+0000","last_change":"2024-09-22T03:11:41.523699+0000","last_active":"2024-09-22T03:12:56.364264+0000","last_peered":"2024-09-22T03:12:56.364264+0000","last_clean":"2024-09-22T03:12:56.364264+0000","last_became_active":"2024-09-22T03:11:41.520422+0000","last_became_peered":"2024-09-22T03:11:41.520422+0000","last_unstale":"2024-09-22T03:12:56.364264+0000","last_undegraded":"2024-09-22T03:12:56.364264+0000","last_fullsized":"2024-09-22T03:12:56.364264+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1471,"log_dups_size":0,"ondisk_log_size":1471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"50'1399","reported_seq":1412,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:55.737633+0000","last_change":"2024-09-22T03:11:41.513541+0000","last_active":"2024-09-22T03:12:55.737633+0000","last_peered":"2024-09-22T03:12:55.737633+0000","last_clean":"2024-09-22T03:12:55.737633+0000","last_became_active":"2024-09-22T03:11:41.509909+0000","last_became_peered":"2024-09-22T03:11:41.509909+0000","last_unstale":"2024-09-22T03:12:55.737633+0000","last_undegraded":"2024-09-22T03:12:55.737633+0000","last_fullsized":"2024-09-22T03:12:55.737633+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1400,"num_write_kb":11200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'1311","reported_seq":1324,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.646065+0000","last_change":"2024-09-22T03:11:41.518404+0000","last_active":"2024-09-22T03:12:56.646065+0000","last_peered":"2024-09-22T03:12:56.646065+0000","last_clean":"2024-09-22T03:12:56.646065+0000","last_became_active":"2024-09-22T03:11:41.513810+0000","last_became_peered":"2024-09-22T03:11:41.513810+0000","last_unstale":"2024-09-22T03:12:56.646065+0000","last_undegraded":"2024-09-22T03:12:56.646065+0000","last_fullsized":"2024-09-22T03:12:56.646065+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1311,"log_dups_size":0,"ondisk_log_size":1311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"50'1335","reported_seq":1348,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.687778+0000","last_change":"2024-09-22T03:11:41.507457+0000","last_active":"2024-09-22T03:12:56.687778+0000","last_peered":"2024-09-22T03:12:56.687778+0000","last_clean":"2024-09-22T03:12:56.687778+0000","last_became_active":"2024-09-22T03:11:41.496687+0000","last_became_peered":"2024-09-22T03:11:41.496687+0000","last_unstale":"2024-09-22T03:12:56.687778+0000","last_undegraded":"2024-09-22T03:12:56.687778+0000","last_fullsized":"2024-09-22T03:12:56.687778+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1335,"log_dups_size":0,"ondisk_log_size":1335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"50'1391","reported_seq":1404,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.441771+0000","last_change":"2024-09-22T03:11:41.548004+0000","last_active":"2024-09-22T03:12:56.441771+0000","last_peered":"2024-09-22T03:12:56.441771+0000","last_clean":"2024-09-22T03:12:56.441771+0000","last_became_active":"2024-09-22T03:11:41.541878+0000","last_became_peered":"2024-09-22T03:11:41.541878+0000","last_unstale":"2024-09-22T03:12:56.441771+0000","last_undegraded":"2024-09-22T03:12:56.441771+0000","last_fullsized":"2024-09-22T03:12:56.441771+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1392,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"50'1239","reported_seq":1252,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.559944+0000","last_change":"2024-09-22T03:11:41.507878+0000","last_active":"2024-09-22T03:12:56.559944+0000","last_peered":"2024-09-22T03:12:56.559944+0000","last_clean":"2024-09-22T03:12:56.559944+0000","last_became_active":"2024-09-22T03:11:41.502557+0000","last_became_peered":"2024-09-22T03:11:41.502557+0000","last_unstale":"2024-09-22T03:12:56.559944+0000","last_undegraded":"2024-09-22T03:12:56.559944+0000","last_fullsized":"2024-09-22T03:12:56.559944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1239,"log_dups_size":0,"ondisk_log_size":1239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"50'1295","reported_seq":1308,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:55.505676+0000","last_change":"2024-09-22T03:11:41.551304+0000","last_active":"2024-09-22T03:12:55.505676+0000","last_peered":"2024-09-22T03:12:55.505676+0000","last_clean":"2024-09-22T03:12:55.505676+0000","last_became_active":"2024-09-22T03:11:41.543833+0000","last_became_peered":"2024-09-22T03:11:41.543833+0000","last_unstale":"2024-09-22T03:12:55.505676+0000","last_undegraded":"2024-09-22T03:12:55.505676+0000","last_fullsized":"2024-09-22T03:12:55.505676+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10616832,"num_objects":162,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.436288+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:11:42.436288+0000","last_peered":"2024-09-22T03:11:42.436288+0000","last_clean":"2024-09-22T03:11:42.436288+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:11:42.436288+0000","last_undegraded":"2024-09-22T03:11:42.436288+0000","last_fullsized":"2024-09-22T03:11:42.436288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"50'1599","reported_seq":1612,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.713175+0000","last_change":"2024-09-22T03:11:41.524387+0000","last_active":"2024-09-22T03:12:56.713175+0000","last_peered":"2024-09-22T03:12:56.713175+0000","last_clean":"2024-09-22T03:12:56.713175+0000","last_became_active":"2024-09-22T03:11:41.517799+0000","last_became_peered":"2024-09-22T03:11:41.517799+0000","last_unstale":"2024-09-22T03:12:56.713175+0000","last_undegraded":"2024-09-22T03:12:56.713175+0000","last_fullsized":"2024-09-22T03:12:56.713175+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1599,"log_dups_size":0,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1600,"num_write_kb":12800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437908+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:11:42.437908+0000","last_peered":"2024-09-22T03:11:42.437908+0000","last_clean":"2024-09-22T03:11:42.437908+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:11:42.437908+0000","last_undegraded":"2024-09-22T03:11:42.437908+0000","last_fullsized":"2024-09-22T03:11:42.437908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"50'1247","reported_seq":1260,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.740653+0000","last_change":"2024-09-22T03:11:41.577187+0000","last_active":"2024-09-22T03:12:56.740653+0000","last_peered":"2024-09-22T03:12:56.740653+0000","last_clean":"2024-09-22T03:12:56.740653+0000","last_became_active":"2024-09-22T03:11:41.553906+0000","last_became_peered":"2024-09-22T03:11:41.553906+0000","last_unstale":"2024-09-22T03:12:56.740653+0000","last_undegraded":"2024-09-22T03:12:56.740653+0000","last_fullsized":"2024-09-22T03:12:56.740653+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1247,"log_dups_size":0,"ondisk_log_size":1247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":9984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":126,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.433377+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:11:42.433377+0000","last_peered":"2024-09-22T03:11:42.433377+0000","last_clean":"2024-09-22T03:11:42.433377+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:11:42.433377+0000","last_undegraded":"2024-09-22T03:11:42.433377+0000","last_fullsized":"2024-09-22T03:11:42.433377+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"50'1335","reported_seq":1348,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.527223+0000","last_change":"2024-09-22T03:11:41.534290+0000","last_active":"2024-09-22T03:12:56.527223+0000","last_peered":"2024-09-22T03:12:56.527223+0000","last_clean":"2024-09-22T03:12:56.527223+0000","last_became_active":"2024-09-22T03:11:41.529404+0000","last_became_peered":"2024-09-22T03:11:41.529404+0000","last_unstale":"2024-09-22T03:12:56.527223+0000","last_undegraded":"2024-09-22T03:12:56.527223+0000","last_fullsized":"2024-09-22T03:12:56.527223+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1335,"log_dups_size":0,"ondisk_log_size":1335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":125,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437423+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:11:42.437423+0000","last_peered":"2024-09-22T03:11:42.437423+0000","last_clean":"2024-09-22T03:11:42.437423+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:11:42.437423+0000","last_undegraded":"2024-09-22T03:11:42.437423+0000","last_fullsized":"2024-09-22T03:11:42.437423+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441374+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:11:42.441374+0000","last_peered":"2024-09-22T03:11:42.441374+0000","last_clean":"2024-09-22T03:11:42.441374+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:11:42.441374+0000","last_undegraded":"2024-09-22T03:11:42.441374+0000","last_fullsized":"2024-09-22T03:11:42.441374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"50'1351","reported_seq":1364,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.231569+0000","last_change":"2024-09-22T03:11:41.531581+0000","last_active":"2024-09-22T03:12:56.231569+0000","last_peered":"2024-09-22T03:12:56.231569+0000","last_clean":"2024-09-22T03:12:56.231569+0000","last_became_active":"2024-09-22T03:11:41.525831+0000","last_became_peered":"2024-09-22T03:11:41.525831+0000","last_unstale":"2024-09-22T03:12:56.231569+0000","last_undegraded":"2024-09-22T03:12:56.231569+0000","last_fullsized":"2024-09-22T03:12:56.231569+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1351,"log_dups_size":0,"ondisk_log_size":1351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075584,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.439011+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:11:42.439011+0000","last_peered":"2024-09-22T03:11:42.439011+0000","last_clean":"2024-09-22T03:11:42.439011+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:11:42.439011+0000","last_undegraded":"2024-09-22T03:11:42.439011+0000","last_fullsized":"2024-09-22T03:11:42.439011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"50'1255","reported_seq":1268,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.521739+0000","last_change":"2024-09-22T03:11:41.533626+0000","last_active":"2024-09-22T03:12:56.521739+0000","last_peered":"2024-09-22T03:12:56.521739+0000","last_clean":"2024-09-22T03:12:56.521739+0000","last_became_active":"2024-09-22T03:11:41.527097+0000","last_became_peered":"2024-09-22T03:11:41.527097+0000","last_unstale":"2024-09-22T03:12:56.521739+0000","last_undegraded":"2024-09-22T03:12:56.521739+0000","last_fullsized":"2024-09-22T03:12:56.521739+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1256,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.438284+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:11:42.438284+0000","last_peered":"2024-09-22T03:11:42.438284+0000","last_clean":"2024-09-22T03:11:42.438284+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:11:42.438284+0000","last_undegraded":"2024-09-22T03:11:42.438284+0000","last_fullsized":"2024-09-22T03:11:42.438284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"50'1391","reported_seq":1404,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:56.194578+0000","last_change":"2024-09-22T03:11:41.522320+0000","last_active":"2024-09-22T03:12:56.194578+0000","last_peered":"2024-09-22T03:12:56.194578+0000","last_clean":"2024-09-22T03:12:56.194578+0000","last_became_active":"2024-09-22T03:11:41.514872+0000","last_became_peered":"2024-09-22T03:11:41.514872+0000","last_unstale":"2024-09-22T03:12:56.194578+0000","last_undegraded":"2024-09-22T03:12:56.194578+0000","last_fullsized":"2024-09-22T03:12:56.194578+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1392,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.442945+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:11:42.442945+0000","last_peered":"2024-09-22T03:11:42.442945+0000","last_clean":"2024-09-22T03:11:42.442945+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:11:42.442945+0000","last_undegraded":"2024-09-22T03:11:42.442945+0000","last_fullsized":"2024-09-22T03:11:42.442945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"50'1359","reported_seq":1372,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:55.644330+0000","last_change":"2024-09-22T03:11:41.514921+0000","last_active":"2024-09-22T03:12:55.644330+0000","last_peered":"2024-09-22T03:12:55.644330+0000","last_clean":"2024-09-22T03:12:55.644330+0000","last_became_active":"2024-09-22T03:11:41.509520+0000","last_became_peered":"2024-09-22T03:11:41.509520+0000","last_unstale":"2024-09-22T03:12:55.644330+0000","last_undegraded":"2024-09-22T03:12:55.644330+0000","last_fullsized":"2024-09-22T03:12:55.644330+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1359,"log_dups_size":0,"ondisk_log_size":1359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441783+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:11:42.441783+0000","last_peered":"2024-09-22T03:11:42.441783+0000","last_clean":"2024-09-22T03:11:42.441783+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:11:42.441783+0000","last_undegraded":"2024-09-22T03:11:42.441783+0000","last_fullsized":"2024-09-22T03:11:42.441783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":177758208,"num_objects":2713,"num_object_clones":0,"num_object_copies":8139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21699,"num_write_kb":173592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":265932800,"data_stored":531865600,"data_compressed":27459942,"data_compressed_allocated":265932800,"data_compressed_original":531865600,"omap_allocated":0,"internal_metadata":0},"log_size":21683,"ondisk_log_size":21683,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128420,"kb_used_data":81300,"kb_used_omap":0,"kb_used_meta":47104,"kb_avail":94243420,"statfs":{"total":96636764160,"available":96505262080,"internally_reserved":0,"allocated":83251200,"data_stored":165787744,"data_compressed":8551591,"data_compressed_allocated":82817024,"data_compressed_original":165634048,"omap_allocated":0,"internal_metadata":48234496},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81672,"kb_used_data":49016,"kb_used_omap":0,"kb_used_meta":32640,"kb_avail":94290168,"statfs":{"total":96636764160,"available":96553132032,"internally_reserved":0,"allocated":50192384,"data_stored":100137600,"data_compressed":5161558,"data_compressed_allocated":49737728,"data_compressed_original":99966976,"omap_allocated":0,"internal_metadata":33423360},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125988,"kb_used_data":71572,"kb_used_omap":0,"kb_used_meta":54400,"kb_avail":94245852,"statfs":{"total":96636764160,"available":96507752448,"internally_reserved":0,"allocated":73289728,"data_stored":146332288,"data_compressed":7546605,"data_compressed_allocated":72835072,"data_compressed_original":146161664,"omap_allocated":0,"internal_metadata":55705600},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86068,"kb_used_data":58084,"kb_used_omap":0,"kb_used_meta":27968,"kb_avail":94285772,"statfs":{"total":96636764160,"available":96548630528,"internally_reserved":0,"allocated":59478016,"data_stored":118717037,"data_compressed":6120868,"data_compressed_allocated":59027456,"data_compressed_original":118546432,"omap_allocated":0,"internal_metadata":28639232},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":59441152,"data_stored":118882304,"data_compressed":6137861,"data_compressed_allocated":59441152,"data_compressed_original":118882304,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73187328,"data_stored":146374656,"data_compressed":7557253,"data_compressed_allocated":73187328,"data_compressed_original":146374656,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":50003968,"data_stored":100007936,"data_compressed":5163323,"data_compressed_allocated":50003968,"data_compressed_original":100007936,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":83300352,"data_stored":166600704,"data_compressed":8601505,"data_compressed_allocated":83300352,"data_compressed_original":166600704,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:12:57.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 75 16 21886 21870 2.27794 1.85156 0.0861508 0.054823 2024-09-22T03:12:58.471 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:12:58.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 76 16 22140 22124 2.27408 1.98438 0.0352534 0.0549379 2024-09-22T03:12:58.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:58.586+0000 7f394c957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:58.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:12:58.592+0000 7f394c957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:12:59.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 77 16 22380 22364 2.26889 1.875 0.0792937 0.0550671 2024-09-22T03:13:00.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 78 16 22616 22600 2.26344 1.84375 0.0679161 0.0551944 2024-09-22T03:13:00.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:01.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:01.043+0000 7fd206a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:01.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:01.049+0000 7fd206a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:01.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 79 16 22867 22851 2.25961 1.96094 0.0357227 0.0552915 2024-09-22T03:13:02.493 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:13:02.493 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:13:02.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:13:02.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:13:02.515887+0000 min lat: 0.00893235 max lat: 0.198995 avg lat: 0.0554081 2024-09-22T03:13:02.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:13:02.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 80 16 23105 23089 2.2546 1.85938 0.064568 0.0554081 2024-09-22T03:13:02.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:02.617+0000 7fcfb9397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:02.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:02.625+0000 7fcfb9397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:02.868 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:13:02.869 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:13:02.886 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-22T03:13:02.782986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":188211763,"num_objects":2867,"num_object_clones":0,"num_object_copies":8601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":23042,"num_write_kb":185120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22987,"ondisk_log_size":22987,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":453712,"kb_used_data":274888,"kb_used_omap":0,"kb_used_meta":178752,"kb_avail":377033648,"statfs":{"total":386547056640,"available":386082455552,"internally_reserved":0,"allocated":281485312,"data_stored":561522637,"data_compressed":28957986,"data_compressed_allocated":279691264,"data_compressed_original":560857088,"omap_allocated":0,"internal_metadata":183042048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":30269440,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3695,"num_write_kb":29560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002030"},"pg_stats":[{"pgid":"7.f","version":"50'1407","reported_seq":1420,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:00.374208+0000","last_change":"2024-09-22T03:11:41.549868+0000","last_active":"2024-09-22T03:13:00.374208+0000","last_peered":"2024-09-22T03:13:00.374208+0000","last_clean":"2024-09-22T03:13:00.374208+0000","last_became_active":"2024-09-22T03:11:41.545171+0000","last_became_peered":"2024-09-22T03:11:41.545171+0000","last_unstale":"2024-09-22T03:13:00.374208+0000","last_undegraded":"2024-09-22T03:13:00.374208+0000","last_fullsized":"2024-09-22T03:13:00.374208+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"50'1447","reported_seq":1460,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.570585+0000","last_change":"2024-09-22T03:11:41.496023+0000","last_active":"2024-09-22T03:13:01.570585+0000","last_peered":"2024-09-22T03:13:01.570585+0000","last_clean":"2024-09-22T03:13:01.570585+0000","last_became_active":"2024-09-22T03:11:41.492941+0000","last_became_peered":"2024-09-22T03:11:41.492941+0000","last_unstale":"2024-09-22T03:13:01.570585+0000","last_undegraded":"2024-09-22T03:13:01.570585+0000","last_fullsized":"2024-09-22T03:13:01.570585+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1447,"log_dups_size":0,"ondisk_log_size":1447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1448,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"50'1535","reported_seq":1548,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.683228+0000","last_change":"2024-09-22T03:11:41.523699+0000","last_active":"2024-09-22T03:13:01.683228+0000","last_peered":"2024-09-22T03:13:01.683228+0000","last_clean":"2024-09-22T03:13:01.683228+0000","last_became_active":"2024-09-22T03:11:41.520422+0000","last_became_peered":"2024-09-22T03:11:41.520422+0000","last_unstale":"2024-09-22T03:13:01.683228+0000","last_undegraded":"2024-09-22T03:13:01.683228+0000","last_fullsized":"2024-09-22T03:13:01.683228+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1536,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"50'1519","reported_seq":1532,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.520891+0000","last_change":"2024-09-22T03:11:41.513541+0000","last_active":"2024-09-22T03:13:01.520891+0000","last_peered":"2024-09-22T03:13:01.520891+0000","last_clean":"2024-09-22T03:13:01.520891+0000","last_became_active":"2024-09-22T03:11:41.509909+0000","last_became_peered":"2024-09-22T03:11:41.509909+0000","last_unstale":"2024-09-22T03:13:01.520891+0000","last_undegraded":"2024-09-22T03:13:01.520891+0000","last_fullsized":"2024-09-22T03:13:01.520891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1519,"log_dups_size":0,"ondisk_log_size":1519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1520,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'1390","reported_seq":1403,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.761927+0000","last_change":"2024-09-22T03:11:41.518404+0000","last_active":"2024-09-22T03:13:01.761927+0000","last_peered":"2024-09-22T03:13:01.761927+0000","last_clean":"2024-09-22T03:13:01.761927+0000","last_became_active":"2024-09-22T03:11:41.513810+0000","last_became_peered":"2024-09-22T03:11:41.513810+0000","last_unstale":"2024-09-22T03:13:01.761927+0000","last_undegraded":"2024-09-22T03:13:01.761927+0000","last_fullsized":"2024-09-22T03:13:01.761927+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11395072,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1391,"num_write_kb":11128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"50'1423","reported_seq":1436,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.716526+0000","last_change":"2024-09-22T03:11:41.507457+0000","last_active":"2024-09-22T03:13:01.716526+0000","last_peered":"2024-09-22T03:13:01.716526+0000","last_clean":"2024-09-22T03:13:01.716526+0000","last_became_active":"2024-09-22T03:11:41.496687+0000","last_became_peered":"2024-09-22T03:11:41.496687+0000","last_unstale":"2024-09-22T03:13:01.716526+0000","last_undegraded":"2024-09-22T03:13:01.716526+0000","last_fullsized":"2024-09-22T03:13:01.716526+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11665408,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1424,"num_write_kb":11392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"50'1479","reported_seq":1492,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.631608+0000","last_change":"2024-09-22T03:11:41.548004+0000","last_active":"2024-09-22T03:13:01.631608+0000","last_peered":"2024-09-22T03:13:01.631608+0000","last_clean":"2024-09-22T03:13:01.631608+0000","last_became_active":"2024-09-22T03:11:41.541878+0000","last_became_peered":"2024-09-22T03:11:41.541878+0000","last_unstale":"2024-09-22T03:13:01.631608+0000","last_undegraded":"2024-09-22T03:13:01.631608+0000","last_fullsized":"2024-09-22T03:13:01.631608+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1479,"log_dups_size":0,"ondisk_log_size":1479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1480,"num_write_kb":11840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"50'1303","reported_seq":1316,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.416695+0000","last_change":"2024-09-22T03:11:41.507878+0000","last_active":"2024-09-22T03:13:01.416695+0000","last_peered":"2024-09-22T03:13:01.416695+0000","last_clean":"2024-09-22T03:13:01.416695+0000","last_became_active":"2024-09-22T03:11:41.502557+0000","last_became_peered":"2024-09-22T03:11:41.502557+0000","last_unstale":"2024-09-22T03:13:01.416695+0000","last_undegraded":"2024-09-22T03:13:01.416695+0000","last_fullsized":"2024-09-22T03:13:01.416695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"50'1359","reported_seq":1372,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:12:59.951531+0000","last_change":"2024-09-22T03:11:41.551304+0000","last_active":"2024-09-22T03:12:59.951531+0000","last_peered":"2024-09-22T03:12:59.951531+0000","last_clean":"2024-09-22T03:12:59.951531+0000","last_became_active":"2024-09-22T03:11:41.543833+0000","last_became_peered":"2024-09-22T03:11:41.543833+0000","last_unstale":"2024-09-22T03:12:59.951531+0000","last_undegraded":"2024-09-22T03:12:59.951531+0000","last_fullsized":"2024-09-22T03:12:59.951531+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1359,"log_dups_size":0,"ondisk_log_size":1359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.436288+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:11:42.436288+0000","last_peered":"2024-09-22T03:11:42.436288+0000","last_clean":"2024-09-22T03:11:42.436288+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:11:42.436288+0000","last_undegraded":"2024-09-22T03:11:42.436288+0000","last_fullsized":"2024-09-22T03:11:42.436288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"50'1679","reported_seq":1692,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.434456+0000","last_change":"2024-09-22T03:11:41.524387+0000","last_active":"2024-09-22T03:13:01.434456+0000","last_peered":"2024-09-22T03:13:01.434456+0000","last_clean":"2024-09-22T03:13:01.434456+0000","last_became_active":"2024-09-22T03:11:41.517799+0000","last_became_peered":"2024-09-22T03:11:41.517799+0000","last_unstale":"2024-09-22T03:13:01.434456+0000","last_undegraded":"2024-09-22T03:13:01.434456+0000","last_fullsized":"2024-09-22T03:13:01.434456+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1680,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437908+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:11:42.437908+0000","last_peered":"2024-09-22T03:11:42.437908+0000","last_clean":"2024-09-22T03:11:42.437908+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:11:42.437908+0000","last_undegraded":"2024-09-22T03:11:42.437908+0000","last_fullsized":"2024-09-22T03:11:42.437908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"50'1295","reported_seq":1308,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.310757+0000","last_change":"2024-09-22T03:11:41.577187+0000","last_active":"2024-09-22T03:13:01.310757+0000","last_peered":"2024-09-22T03:13:01.310757+0000","last_clean":"2024-09-22T03:13:01.310757+0000","last_became_active":"2024-09-22T03:11:41.553906+0000","last_became_peered":"2024-09-22T03:11:41.553906+0000","last_unstale":"2024-09-22T03:13:01.310757+0000","last_undegraded":"2024-09-22T03:13:01.310757+0000","last_fullsized":"2024-09-22T03:13:01.310757+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10616832,"num_objects":162,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":126,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.433377+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:11:42.433377+0000","last_peered":"2024-09-22T03:11:42.433377+0000","last_clean":"2024-09-22T03:11:42.433377+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:11:42.433377+0000","last_undegraded":"2024-09-22T03:11:42.433377+0000","last_fullsized":"2024-09-22T03:11:42.433377+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"50'1439","reported_seq":1452,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.064776+0000","last_change":"2024-09-22T03:11:41.534290+0000","last_active":"2024-09-22T03:13:01.064776+0000","last_peered":"2024-09-22T03:13:01.064776+0000","last_clean":"2024-09-22T03:13:01.064776+0000","last_became_active":"2024-09-22T03:11:41.529404+0000","last_became_peered":"2024-09-22T03:11:41.529404+0000","last_unstale":"2024-09-22T03:13:01.064776+0000","last_undegraded":"2024-09-22T03:13:01.064776+0000","last_fullsized":"2024-09-22T03:13:01.064776+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1440,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":125,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437423+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:11:42.437423+0000","last_peered":"2024-09-22T03:11:42.437423+0000","last_clean":"2024-09-22T03:11:42.437423+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:11:42.437423+0000","last_undegraded":"2024-09-22T03:11:42.437423+0000","last_fullsized":"2024-09-22T03:11:42.437423+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441374+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:11:42.441374+0000","last_peered":"2024-09-22T03:11:42.441374+0000","last_clean":"2024-09-22T03:11:42.441374+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:11:42.441374+0000","last_undegraded":"2024-09-22T03:11:42.441374+0000","last_fullsized":"2024-09-22T03:11:42.441374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"50'1407","reported_seq":1420,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.173892+0000","last_change":"2024-09-22T03:11:41.531581+0000","last_active":"2024-09-22T03:13:01.173892+0000","last_peered":"2024-09-22T03:13:01.173892+0000","last_clean":"2024-09-22T03:13:01.173892+0000","last_became_active":"2024-09-22T03:11:41.525831+0000","last_became_peered":"2024-09-22T03:11:41.525831+0000","last_unstale":"2024-09-22T03:13:01.173892+0000","last_undegraded":"2024-09-22T03:13:01.173892+0000","last_fullsized":"2024-09-22T03:13:01.173892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.439011+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:11:42.439011+0000","last_peered":"2024-09-22T03:11:42.439011+0000","last_clean":"2024-09-22T03:11:42.439011+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:11:42.439011+0000","last_undegraded":"2024-09-22T03:11:42.439011+0000","last_fullsized":"2024-09-22T03:11:42.439011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"50'1287","reported_seq":1300,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.231652+0000","last_change":"2024-09-22T03:11:41.533626+0000","last_active":"2024-09-22T03:13:01.231652+0000","last_peered":"2024-09-22T03:13:01.231652+0000","last_clean":"2024-09-22T03:13:01.231652+0000","last_became_active":"2024-09-22T03:11:41.527097+0000","last_became_peered":"2024-09-22T03:11:41.527097+0000","last_unstale":"2024-09-22T03:13:01.231652+0000","last_undegraded":"2024-09-22T03:13:01.231652+0000","last_fullsized":"2024-09-22T03:13:01.231652+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1287,"log_dups_size":0,"ondisk_log_size":1287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.438284+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:11:42.438284+0000","last_peered":"2024-09-22T03:11:42.438284+0000","last_clean":"2024-09-22T03:11:42.438284+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:11:42.438284+0000","last_undegraded":"2024-09-22T03:11:42.438284+0000","last_fullsized":"2024-09-22T03:11:42.438284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"50'1471","reported_seq":1484,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:01.476893+0000","last_change":"2024-09-22T03:11:41.522320+0000","last_active":"2024-09-22T03:13:01.476893+0000","last_peered":"2024-09-22T03:13:01.476893+0000","last_clean":"2024-09-22T03:13:01.476893+0000","last_became_active":"2024-09-22T03:11:41.514872+0000","last_became_peered":"2024-09-22T03:11:41.514872+0000","last_unstale":"2024-09-22T03:13:01.476893+0000","last_undegraded":"2024-09-22T03:13:01.476893+0000","last_fullsized":"2024-09-22T03:13:01.476893+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1471,"log_dups_size":0,"ondisk_log_size":1471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.442945+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:11:42.442945+0000","last_peered":"2024-09-22T03:11:42.442945+0000","last_clean":"2024-09-22T03:11:42.442945+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:11:42.442945+0000","last_undegraded":"2024-09-22T03:11:42.442945+0000","last_fullsized":"2024-09-22T03:11:42.442945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"50'1447","reported_seq":1460,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:00.730577+0000","last_change":"2024-09-22T03:11:41.514921+0000","last_active":"2024-09-22T03:13:00.730577+0000","last_peered":"2024-09-22T03:13:00.730577+0000","last_clean":"2024-09-22T03:13:00.730577+0000","last_became_active":"2024-09-22T03:11:41.509520+0000","last_became_peered":"2024-09-22T03:11:41.509520+0000","last_unstale":"2024-09-22T03:13:00.730577+0000","last_undegraded":"2024-09-22T03:13:00.730577+0000","last_fullsized":"2024-09-22T03:13:00.730577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1447,"log_dups_size":0,"ondisk_log_size":1447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1448,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441783+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:11:42.441783+0000","last_peered":"2024-09-22T03:11:42.441783+0000","last_clean":"2024-09-22T03:11:42.441783+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:11:42.441783+0000","last_undegraded":"2024-09-22T03:11:42.441783+0000","last_fullsized":"2024-09-22T03:11:42.441783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":187621376,"num_objects":2863,"num_object_clones":0,"num_object_copies":8589,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22903,"num_write_kb":183224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":280985600,"data_stored":561971200,"data_compressed":29014464,"data_compressed_allocated":280985600,"data_compressed_original":561971200,"omap_allocated":0,"internal_metadata":0},"log_size":22887,"ondisk_log_size":22887,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137156,"kb_used_data":85876,"kb_used_omap":0,"kb_used_meta":51264,"kb_avail":94234684,"statfs":{"total":96636764160,"available":96496316416,"internally_reserved":0,"allocated":87937024,"data_stored":175159392,"data_compressed":9035502,"data_compressed_allocated":87502848,"data_compressed_original":175005696,"omap_allocated":0,"internal_metadata":52494336},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88588,"kb_used_data":51768,"kb_used_omap":0,"kb_used_meta":36800,"kb_avail":94283252,"statfs":{"total":96636764160,"available":96546050048,"internally_reserved":0,"allocated":53010432,"data_stored":105773696,"data_compressed":5452581,"data_compressed_allocated":52555776,"data_compressed_original":105603072,"omap_allocated":0,"internal_metadata":37683200},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134288,"kb_used_data":75708,"kb_used_omap":0,"kb_used_meta":58560,"kb_avail":94237552,"statfs":{"total":96636764160,"available":96499253248,"internally_reserved":0,"allocated":77524992,"data_stored":154802816,"data_compressed":7983987,"data_compressed_allocated":77070336,"data_compressed_original":154632192,"omap_allocated":0,"internal_metadata":59965440},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93680,"kb_used_data":61536,"kb_used_omap":0,"kb_used_meta":32128,"kb_avail":94278160,"statfs":{"total":96636764160,"available":96540835840,"internally_reserved":0,"allocated":63012864,"data_stored":125786733,"data_compressed":6485916,"data_compressed_allocated":62562304,"data_compressed_original":125616128,"omap_allocated":0,"internal_metadata":32899072},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62783488,"data_stored":125566976,"data_compressed":6483028,"data_compressed_allocated":62783488,"data_compressed_original":125566976,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77414400,"data_stored":154828800,"data_compressed":7993789,"data_compressed_allocated":77414400,"data_compressed_original":154828800,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":52854784,"data_stored":105709568,"data_compressed":5457730,"data_compressed_allocated":52854784,"data_compressed_original":105709568,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":87932928,"data_stored":175865856,"data_compressed":9079917,"data_compressed_allocated":87932928,"data_compressed_original":175865856,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:13:03.242 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:03.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:03.380+0000 7fa80d517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:03.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:03.385+0000 7fa80d517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:03.516 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 81 16 23335 23319 2.24895 1.79688 0.121495 0.0555404 2024-09-22T03:13:04.517 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 82 16 23576 23560 2.24448 1.88281 0.0455508 0.0556568 2024-09-22T03:13:05.517 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 83 16 23843 23827 2.24257 2.08594 0.0682922 0.0557027 2024-09-22T03:13:05.552 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:05.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:05.660+0000 7f95cdb4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:05.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:05.665+0000 7f95cdb4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:06.517 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 84 16 24082 24066 2.2381 1.86719 0.0583415 0.0558166 2024-09-22T03:13:07.517 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 85 16 24334 24318 2.23493 1.96875 0.0723246 0.0558965 2024-09-22T03:13:07.888 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:13:07.888 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:13:07.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:13:07.899 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:08.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:08.033+0000 7fda49218640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:08.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:08.044+0000 7fda49218640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:08.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:08.052+0000 7f66c8858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:08.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:08.060+0000 7f66c8858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:08.338 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:13:08.339 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:13:08.353 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-22T03:13:06.783602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198115891,"num_objects":3019,"num_object_clones":0,"num_object_copies":9057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":24251,"num_write_kb":194792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24196,"ondisk_log_size":24196,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":486260,"kb_used_data":289396,"kb_used_omap":0,"kb_used_meta":196800,"kb_avail":377001100,"statfs":{"total":386547056640,"available":386049126400,"internally_reserved":0,"allocated":296341504,"data_stored":591235021,"data_compressed":30492207,"data_compressed_allocated":294547456,"data_compressed_original":590569472,"omap_allocated":0,"internal_metadata":201523200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":30253056,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3693,"num_write_kb":29544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001934"},"pg_stats":[{"pgid":"7.f","version":"50'1463","reported_seq":1476,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.396106+0000","last_change":"2024-09-22T03:11:41.549868+0000","last_active":"2024-09-22T03:13:06.396106+0000","last_peered":"2024-09-22T03:13:06.396106+0000","last_clean":"2024-09-22T03:13:06.396106+0000","last_became_active":"2024-09-22T03:11:41.545171+0000","last_became_peered":"2024-09-22T03:11:41.545171+0000","last_unstale":"2024-09-22T03:13:06.396106+0000","last_undegraded":"2024-09-22T03:13:06.396106+0000","last_fullsized":"2024-09-22T03:13:06.396106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1463,"log_dups_size":0,"ondisk_log_size":1463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1464,"num_write_kb":11712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"50'1527","reported_seq":1540,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.465631+0000","last_change":"2024-09-22T03:11:41.496023+0000","last_active":"2024-09-22T03:13:06.465631+0000","last_peered":"2024-09-22T03:13:06.465631+0000","last_clean":"2024-09-22T03:13:06.465631+0000","last_became_active":"2024-09-22T03:11:41.492941+0000","last_became_peered":"2024-09-22T03:11:41.492941+0000","last_unstale":"2024-09-22T03:13:06.465631+0000","last_undegraded":"2024-09-22T03:13:06.465631+0000","last_fullsized":"2024-09-22T03:13:06.465631+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1527,"log_dups_size":0,"ondisk_log_size":1527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12517376,"num_objects":191,"num_object_clones":0,"num_object_copies":573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1528,"num_write_kb":12224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"50'1559","reported_seq":1572,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.008441+0000","last_change":"2024-09-22T03:11:41.523699+0000","last_active":"2024-09-22T03:13:06.008441+0000","last_peered":"2024-09-22T03:13:06.008441+0000","last_clean":"2024-09-22T03:13:06.008441+0000","last_became_active":"2024-09-22T03:11:41.520422+0000","last_became_peered":"2024-09-22T03:11:41.520422+0000","last_unstale":"2024-09-22T03:13:06.008441+0000","last_undegraded":"2024-09-22T03:13:06.008441+0000","last_fullsized":"2024-09-22T03:13:06.008441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1559,"log_dups_size":0,"ondisk_log_size":1559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779520,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1560,"num_write_kb":12480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"50'1631","reported_seq":1644,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.578090+0000","last_change":"2024-09-22T03:11:41.513541+0000","last_active":"2024-09-22T03:13:06.578090+0000","last_peered":"2024-09-22T03:13:06.578090+0000","last_clean":"2024-09-22T03:13:06.578090+0000","last_became_active":"2024-09-22T03:11:41.509909+0000","last_became_peered":"2024-09-22T03:11:41.509909+0000","last_unstale":"2024-09-22T03:13:06.578090+0000","last_undegraded":"2024-09-22T03:13:06.578090+0000","last_fullsized":"2024-09-22T03:13:06.578090+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1631,"log_dups_size":0,"ondisk_log_size":1631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1632,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'1439","reported_seq":1452,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.722577+0000","last_change":"2024-09-22T03:11:41.518404+0000","last_active":"2024-09-22T03:13:06.722577+0000","last_peered":"2024-09-22T03:13:06.722577+0000","last_clean":"2024-09-22T03:13:06.722577+0000","last_became_active":"2024-09-22T03:11:41.513810+0000","last_became_peered":"2024-09-22T03:11:41.513810+0000","last_unstale":"2024-09-22T03:13:06.722577+0000","last_undegraded":"2024-09-22T03:13:06.722577+0000","last_fullsized":"2024-09-22T03:13:06.722577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1440,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"50'1503","reported_seq":1516,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.678459+0000","last_change":"2024-09-22T03:11:41.507457+0000","last_active":"2024-09-22T03:13:06.678459+0000","last_peered":"2024-09-22T03:13:06.678459+0000","last_clean":"2024-09-22T03:13:06.678459+0000","last_became_active":"2024-09-22T03:11:41.496687+0000","last_became_peered":"2024-09-22T03:11:41.496687+0000","last_unstale":"2024-09-22T03:13:06.678459+0000","last_undegraded":"2024-09-22T03:13:06.678459+0000","last_fullsized":"2024-09-22T03:13:06.678459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12320768,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1504,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"50'1582","reported_seq":1595,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.736693+0000","last_change":"2024-09-22T03:11:41.548004+0000","last_active":"2024-09-22T03:13:06.736693+0000","last_peered":"2024-09-22T03:13:06.736693+0000","last_clean":"2024-09-22T03:13:06.736693+0000","last_became_active":"2024-09-22T03:11:41.541878+0000","last_became_peered":"2024-09-22T03:11:41.541878+0000","last_unstale":"2024-09-22T03:13:06.736693+0000","last_undegraded":"2024-09-22T03:13:06.736693+0000","last_fullsized":"2024-09-22T03:13:06.736693+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1582,"log_dups_size":0,"ondisk_log_size":1582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12967936,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1583,"num_write_kb":12664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"50'1407","reported_seq":1420,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.652189+0000","last_change":"2024-09-22T03:11:41.507878+0000","last_active":"2024-09-22T03:13:06.652189+0000","last_peered":"2024-09-22T03:13:06.652189+0000","last_clean":"2024-09-22T03:13:06.652189+0000","last_became_active":"2024-09-22T03:11:41.502557+0000","last_became_peered":"2024-09-22T03:11:41.502557+0000","last_unstale":"2024-09-22T03:13:06.652189+0000","last_undegraded":"2024-09-22T03:13:06.652189+0000","last_fullsized":"2024-09-22T03:13:06.652189+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"50'1439","reported_seq":1452,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:05.941325+0000","last_change":"2024-09-22T03:11:41.551304+0000","last_active":"2024-09-22T03:13:05.941325+0000","last_peered":"2024-09-22T03:13:05.941325+0000","last_clean":"2024-09-22T03:13:05.941325+0000","last_became_active":"2024-09-22T03:11:41.543833+0000","last_became_peered":"2024-09-22T03:11:41.543833+0000","last_unstale":"2024-09-22T03:13:05.941325+0000","last_undegraded":"2024-09-22T03:13:05.941325+0000","last_fullsized":"2024-09-22T03:13:05.941325+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1440,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.436288+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:11:42.436288+0000","last_peered":"2024-09-22T03:11:42.436288+0000","last_clean":"2024-09-22T03:11:42.436288+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:11:42.436288+0000","last_undegraded":"2024-09-22T03:11:42.436288+0000","last_fullsized":"2024-09-22T03:11:42.436288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"50'1783","reported_seq":1796,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.489234+0000","last_change":"2024-09-22T03:11:41.524387+0000","last_active":"2024-09-22T03:13:06.489234+0000","last_peered":"2024-09-22T03:13:06.489234+0000","last_clean":"2024-09-22T03:13:06.489234+0000","last_became_active":"2024-09-22T03:11:41.517799+0000","last_became_peered":"2024-09-22T03:11:41.517799+0000","last_unstale":"2024-09-22T03:13:06.489234+0000","last_undegraded":"2024-09-22T03:13:06.489234+0000","last_fullsized":"2024-09-22T03:13:06.489234+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14614528,"num_objects":223,"num_object_clones":0,"num_object_copies":669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":14272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437908+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:11:42.437908+0000","last_peered":"2024-09-22T03:11:42.437908+0000","last_clean":"2024-09-22T03:11:42.437908+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:11:42.437908+0000","last_undegraded":"2024-09-22T03:11:42.437908+0000","last_fullsized":"2024-09-22T03:11:42.437908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"50'1319","reported_seq":1332,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:04.606092+0000","last_change":"2024-09-22T03:11:41.577187+0000","last_active":"2024-09-22T03:13:04.606092+0000","last_peered":"2024-09-22T03:13:04.606092+0000","last_clean":"2024-09-22T03:13:04.606092+0000","last_became_active":"2024-09-22T03:11:41.553906+0000","last_became_peered":"2024-09-22T03:11:41.553906+0000","last_unstale":"2024-09-22T03:13:04.606092+0000","last_undegraded":"2024-09-22T03:13:04.606092+0000","last_fullsized":"2024-09-22T03:13:04.606092+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1319,"log_dups_size":0,"ondisk_log_size":1319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1320,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":126,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.433377+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:11:42.433377+0000","last_peered":"2024-09-22T03:11:42.433377+0000","last_clean":"2024-09-22T03:11:42.433377+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:11:42.433377+0000","last_undegraded":"2024-09-22T03:11:42.433377+0000","last_fullsized":"2024-09-22T03:11:42.433377+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"50'1511","reported_seq":1524,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.082798+0000","last_change":"2024-09-22T03:11:41.534290+0000","last_active":"2024-09-22T03:13:06.082798+0000","last_peered":"2024-09-22T03:13:06.082798+0000","last_clean":"2024-09-22T03:13:06.082798+0000","last_became_active":"2024-09-22T03:11:41.529404+0000","last_became_peered":"2024-09-22T03:11:41.529404+0000","last_unstale":"2024-09-22T03:13:06.082798+0000","last_undegraded":"2024-09-22T03:13:06.082798+0000","last_fullsized":"2024-09-22T03:13:06.082798+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1511,"log_dups_size":0,"ondisk_log_size":1511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12386304,"num_objects":189,"num_object_clones":0,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1512,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":125,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437423+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:11:42.437423+0000","last_peered":"2024-09-22T03:11:42.437423+0000","last_clean":"2024-09-22T03:11:42.437423+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:11:42.437423+0000","last_undegraded":"2024-09-22T03:11:42.437423+0000","last_fullsized":"2024-09-22T03:11:42.437423+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441374+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:11:42.441374+0000","last_peered":"2024-09-22T03:11:42.441374+0000","last_clean":"2024-09-22T03:11:42.441374+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:11:42.441374+0000","last_undegraded":"2024-09-22T03:11:42.441374+0000","last_fullsized":"2024-09-22T03:11:42.441374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"50'1487","reported_seq":1500,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:05.294623+0000","last_change":"2024-09-22T03:11:41.531581+0000","last_active":"2024-09-22T03:13:05.294623+0000","last_peered":"2024-09-22T03:13:05.294623+0000","last_clean":"2024-09-22T03:13:05.294623+0000","last_became_active":"2024-09-22T03:11:41.525831+0000","last_became_peered":"2024-09-22T03:11:41.525831+0000","last_unstale":"2024-09-22T03:13:05.294623+0000","last_undegraded":"2024-09-22T03:13:05.294623+0000","last_fullsized":"2024-09-22T03:13:05.294623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1488,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.439011+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:11:42.439011+0000","last_peered":"2024-09-22T03:11:42.439011+0000","last_clean":"2024-09-22T03:11:42.439011+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:11:42.439011+0000","last_undegraded":"2024-09-22T03:11:42.439011+0000","last_fullsized":"2024-09-22T03:11:42.439011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"50'1343","reported_seq":1356,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.618568+0000","last_change":"2024-09-22T03:11:41.533626+0000","last_active":"2024-09-22T03:13:06.618568+0000","last_peered":"2024-09-22T03:13:06.618568+0000","last_clean":"2024-09-22T03:13:06.618568+0000","last_became_active":"2024-09-22T03:11:41.527097+0000","last_became_peered":"2024-09-22T03:11:41.527097+0000","last_unstale":"2024-09-22T03:13:06.618568+0000","last_undegraded":"2024-09-22T03:13:06.618568+0000","last_fullsized":"2024-09-22T03:13:06.618568+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11010048,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":10752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.438284+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:11:42.438284+0000","last_peered":"2024-09-22T03:11:42.438284+0000","last_clean":"2024-09-22T03:11:42.438284+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:11:42.438284+0000","last_undegraded":"2024-09-22T03:11:42.438284+0000","last_fullsized":"2024-09-22T03:11:42.438284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"50'1559","reported_seq":1572,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:06.159604+0000","last_change":"2024-09-22T03:11:41.522320+0000","last_active":"2024-09-22T03:13:06.159604+0000","last_peered":"2024-09-22T03:13:06.159604+0000","last_clean":"2024-09-22T03:13:06.159604+0000","last_became_active":"2024-09-22T03:11:41.514872+0000","last_became_peered":"2024-09-22T03:11:41.514872+0000","last_unstale":"2024-09-22T03:13:06.159604+0000","last_undegraded":"2024-09-22T03:13:06.159604+0000","last_fullsized":"2024-09-22T03:13:06.159604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1559,"log_dups_size":0,"ondisk_log_size":1559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779520,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1560,"num_write_kb":12480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.442945+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:11:42.442945+0000","last_peered":"2024-09-22T03:11:42.442945+0000","last_clean":"2024-09-22T03:11:42.442945+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:11:42.442945+0000","last_undegraded":"2024-09-22T03:11:42.442945+0000","last_fullsized":"2024-09-22T03:11:42.442945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"50'1544","reported_seq":1557,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:05.724392+0000","last_change":"2024-09-22T03:11:41.514921+0000","last_active":"2024-09-22T03:13:05.724392+0000","last_peered":"2024-09-22T03:13:05.724392+0000","last_clean":"2024-09-22T03:13:05.724392+0000","last_became_active":"2024-09-22T03:11:41.509520+0000","last_became_peered":"2024-09-22T03:11:41.509520+0000","last_unstale":"2024-09-22T03:13:05.724392+0000","last_undegraded":"2024-09-22T03:13:05.724392+0000","last_fullsized":"2024-09-22T03:13:05.724392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1544,"log_dups_size":0,"ondisk_log_size":1544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12656640,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1545,"num_write_kb":12360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441783+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:11:42.441783+0000","last_peered":"2024-09-22T03:11:42.441783+0000","last_clean":"2024-09-22T03:11:42.441783+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:11:42.441783+0000","last_undegraded":"2024-09-22T03:11:42.441783+0000","last_fullsized":"2024-09-22T03:11:42.441783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":197525504,"num_objects":3015,"num_object_clones":0,"num_object_copies":9045,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24112,"num_write_kb":192896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295755776,"data_stored":591511552,"data_compressed":30539802,"data_compressed_allocated":295755776,"data_compressed_original":591511552,"omap_allocated":0,"internal_metadata":0},"log_size":24096,"ondisk_log_size":24096,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":145876,"kb_used_data":90436,"kb_used_omap":0,"kb_used_meta":55424,"kb_avail":94225964,"statfs":{"total":96636764160,"available":96487387136,"internally_reserved":0,"allocated":92606464,"data_stored":184498272,"data_compressed":9517722,"data_compressed_allocated":92172288,"data_compressed_original":184344576,"omap_allocated":0,"internal_metadata":56754176},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95444,"kb_used_data":54468,"kb_used_omap":0,"kb_used_meta":40960,"kb_avail":94276396,"statfs":{"total":96636764160,"available":96539029504,"internally_reserved":0,"allocated":55775232,"data_stored":111303296,"data_compressed":5738106,"data_compressed_allocated":55320576,"data_compressed_original":111132672,"omap_allocated":0,"internal_metadata":41943040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126040,"kb_used_data":79944,"kb_used_omap":0,"kb_used_meta":46080,"kb_avail":94245800,"statfs":{"total":96636764160,"available":96507699200,"internally_reserved":0,"allocated":81862656,"data_stored":163478144,"data_compressed":8431944,"data_compressed_allocated":81408000,"data_compressed_original":163307520,"omap_allocated":0,"internal_metadata":47185920},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118900,"kb_used_data":64548,"kb_used_omap":0,"kb_used_meta":54336,"kb_avail":94252940,"statfs":{"total":96636764160,"available":96515010560,"internally_reserved":0,"allocated":66097152,"data_stored":131955309,"data_compressed":6804435,"data_compressed_allocated":65646592,"data_compressed_original":131784704,"omap_allocated":0,"internal_metadata":55640064},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65921024,"data_stored":131842048,"data_compressed":6807046,"data_compressed_allocated":65921024,"data_compressed_original":131842048,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81756160,"data_stored":163512320,"data_compressed":8442169,"data_compressed_allocated":81756160,"data_compressed_original":163512320,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55476224,"data_stored":110952448,"data_compressed":5728450,"data_compressed_allocated":55476224,"data_compressed_original":110952448,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":92602368,"data_stored":185204736,"data_compressed":9562137,"data_compressed_allocated":92602368,"data_compressed_original":185204736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:13:08.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 86 16 24573 24557 2.23065 1.86719 0.0266111 0.0560136 2024-09-22T03:13:09.517 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 87 16 24813 24797 2.22656 1.875 0.0252697 0.0561083 2024-09-22T03:13:10.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:10.517 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 88 16 25041 25025 2.2215 1.78125 0.0746568 0.0562395 2024-09-22T03:13:10.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:10.572+0000 7f5d8dcd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:10.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:10.577+0000 7f5d8dcd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:11.517 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 89 16 25263 25247 2.21602 1.73438 0.0440006 0.0563674 2024-09-22T03:13:12.517 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 90 13 25491 25478 2.21145 1.80469 0.0213473 0.056502 2024-09-22T03:13:12.802 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:12.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:12.904+0000 7f75b1b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:12.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:12.909+0000 7f75b1b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:13.354 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:13:13.355 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:13:13.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:13:13.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:13.455+0000 7fb122957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:13.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:13.462+0000 7fb122957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:13.517 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total time run: 90.045 2024-09-22T03:13:13.517 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total writes made: 25491 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Write size: 8192 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object size: 65536 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Bandwidth (MB/sec): 2.21166 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Bandwidth: 0.302004 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max bandwidth (MB/sec): 2.92188 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min bandwidth (MB/sec): 1.73438 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average IOPS: 283 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev IOPS: 38.6566 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max IOPS: 374 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min IOPS: 222 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average Latency(s): 0.0564991 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Latency(s): 0.0250428 2024-09-22T03:13:13.518 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max latency(s): 0.198995 2024-09-22T03:13:13.519 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min latency(s): 0.00893235 2024-09-22T03:13:13.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:13:13.692 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:13:13.692 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:13:13.711 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-22T03:13:12.784659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":207725107,"num_objects":3166,"num_object_clones":0,"num_object_copies":9498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":25424,"num_write_kb":204176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25369,"ondisk_log_size":25369,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":508780,"kb_used_data":303588,"kb_used_omap":0,"kb_used_meta":205120,"kb_avail":376978580,"statfs":{"total":386547056640,"available":386026065920,"internally_reserved":0,"allocated":310874112,"data_stored":620300237,"data_compressed":31993011,"data_compressed_allocated":309080064,"data_compressed_original":619634688,"omap_allocated":0,"internal_metadata":210042880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28655616,"num_objects":438,"num_object_clones":0,"num_object_copies":1314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3498,"num_write_kb":27984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002048"},"pg_stats":[{"pgid":"7.f","version":"50'1535","reported_seq":1548,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.045276+0000","last_change":"2024-09-22T03:11:41.549868+0000","last_active":"2024-09-22T03:13:11.045276+0000","last_peered":"2024-09-22T03:13:11.045276+0000","last_clean":"2024-09-22T03:13:11.045276+0000","last_became_active":"2024-09-22T03:11:41.545171+0000","last_became_peered":"2024-09-22T03:11:41.545171+0000","last_unstale":"2024-09-22T03:13:11.045276+0000","last_undegraded":"2024-09-22T03:13:11.045276+0000","last_fullsized":"2024-09-22T03:13:11.045276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1536,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"50'1583","reported_seq":1596,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.421297+0000","last_change":"2024-09-22T03:11:41.496023+0000","last_active":"2024-09-22T03:13:11.421297+0000","last_peered":"2024-09-22T03:13:11.421297+0000","last_clean":"2024-09-22T03:13:11.421297+0000","last_became_active":"2024-09-22T03:11:41.492941+0000","last_became_peered":"2024-09-22T03:11:41.492941+0000","last_unstale":"2024-09-22T03:13:11.421297+0000","last_undegraded":"2024-09-22T03:13:11.421297+0000","last_fullsized":"2024-09-22T03:13:11.421297+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1583,"log_dups_size":0,"ondisk_log_size":1583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12976128,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1584,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"50'1624","reported_seq":1637,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.312170+0000","last_change":"2024-09-22T03:11:41.523699+0000","last_active":"2024-09-22T03:13:11.312170+0000","last_peered":"2024-09-22T03:13:11.312170+0000","last_clean":"2024-09-22T03:13:11.312170+0000","last_became_active":"2024-09-22T03:11:41.520422+0000","last_became_peered":"2024-09-22T03:11:41.520422+0000","last_unstale":"2024-09-22T03:13:11.312170+0000","last_undegraded":"2024-09-22T03:13:11.312170+0000","last_fullsized":"2024-09-22T03:13:11.312170+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1624,"log_dups_size":0,"ondisk_log_size":1624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13312000,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1625,"num_write_kb":13000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"50'1703","reported_seq":1716,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:10.913092+0000","last_change":"2024-09-22T03:11:41.513541+0000","last_active":"2024-09-22T03:13:10.913092+0000","last_peered":"2024-09-22T03:13:10.913092+0000","last_clean":"2024-09-22T03:13:10.913092+0000","last_became_active":"2024-09-22T03:11:41.509909+0000","last_became_peered":"2024-09-22T03:11:41.509909+0000","last_unstale":"2024-09-22T03:13:10.913092+0000","last_undegraded":"2024-09-22T03:13:10.913092+0000","last_fullsized":"2024-09-22T03:13:10.913092+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1703,"log_dups_size":0,"ondisk_log_size":1703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1704,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'1503","reported_seq":1516,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.666066+0000","last_change":"2024-09-22T03:11:41.518404+0000","last_active":"2024-09-22T03:13:11.666066+0000","last_peered":"2024-09-22T03:13:11.666066+0000","last_clean":"2024-09-22T03:13:11.666066+0000","last_became_active":"2024-09-22T03:11:41.513810+0000","last_became_peered":"2024-09-22T03:11:41.513810+0000","last_unstale":"2024-09-22T03:13:11.666066+0000","last_undegraded":"2024-09-22T03:13:11.666066+0000","last_fullsized":"2024-09-22T03:13:11.666066+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12320768,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1504,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"50'1567","reported_seq":1580,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:10.998151+0000","last_change":"2024-09-22T03:11:41.507457+0000","last_active":"2024-09-22T03:13:10.998151+0000","last_peered":"2024-09-22T03:13:10.998151+0000","last_clean":"2024-09-22T03:13:10.998151+0000","last_became_active":"2024-09-22T03:11:41.496687+0000","last_became_peered":"2024-09-22T03:11:41.496687+0000","last_unstale":"2024-09-22T03:13:10.998151+0000","last_undegraded":"2024-09-22T03:13:10.998151+0000","last_fullsized":"2024-09-22T03:13:10.998151+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1567,"log_dups_size":0,"ondisk_log_size":1567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12845056,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1568,"num_write_kb":12544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"50'1663","reported_seq":1676,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.479072+0000","last_change":"2024-09-22T03:11:41.548004+0000","last_active":"2024-09-22T03:13:11.479072+0000","last_peered":"2024-09-22T03:13:11.479072+0000","last_clean":"2024-09-22T03:13:11.479072+0000","last_became_active":"2024-09-22T03:11:41.541878+0000","last_became_peered":"2024-09-22T03:11:41.541878+0000","last_unstale":"2024-09-22T03:13:11.479072+0000","last_undegraded":"2024-09-22T03:13:11.479072+0000","last_fullsized":"2024-09-22T03:13:11.479072+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1664,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"50'1519","reported_seq":1532,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.591374+0000","last_change":"2024-09-22T03:11:41.507878+0000","last_active":"2024-09-22T03:13:11.591374+0000","last_peered":"2024-09-22T03:13:11.591374+0000","last_clean":"2024-09-22T03:13:11.591374+0000","last_became_active":"2024-09-22T03:11:41.502557+0000","last_became_peered":"2024-09-22T03:11:41.502557+0000","last_unstale":"2024-09-22T03:13:11.591374+0000","last_undegraded":"2024-09-22T03:13:11.591374+0000","last_fullsized":"2024-09-22T03:13:11.591374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1519,"log_dups_size":0,"ondisk_log_size":1519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1520,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"50'1511","reported_seq":1524,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.254315+0000","last_change":"2024-09-22T03:11:41.551304+0000","last_active":"2024-09-22T03:13:11.254315+0000","last_peered":"2024-09-22T03:13:11.254315+0000","last_clean":"2024-09-22T03:13:11.254315+0000","last_became_active":"2024-09-22T03:11:41.543833+0000","last_became_peered":"2024-09-22T03:11:41.543833+0000","last_unstale":"2024-09-22T03:13:11.254315+0000","last_undegraded":"2024-09-22T03:13:11.254315+0000","last_fullsized":"2024-09-22T03:13:11.254315+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1511,"log_dups_size":0,"ondisk_log_size":1511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12386304,"num_objects":189,"num_object_clones":0,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1512,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.436288+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:11:42.436288+0000","last_peered":"2024-09-22T03:11:42.436288+0000","last_clean":"2024-09-22T03:11:42.436288+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:11:42.436288+0000","last_undegraded":"2024-09-22T03:11:42.436288+0000","last_fullsized":"2024-09-22T03:11:42.436288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"50'1847","reported_seq":1860,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.148599+0000","last_change":"2024-09-22T03:11:41.524387+0000","last_active":"2024-09-22T03:13:11.148599+0000","last_peered":"2024-09-22T03:13:11.148599+0000","last_clean":"2024-09-22T03:13:11.148599+0000","last_became_active":"2024-09-22T03:11:41.517799+0000","last_became_peered":"2024-09-22T03:11:41.517799+0000","last_unstale":"2024-09-22T03:13:11.148599+0000","last_undegraded":"2024-09-22T03:13:11.148599+0000","last_fullsized":"2024-09-22T03:13:11.148599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1848,"num_write_kb":14784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437908+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:11:42.437908+0000","last_peered":"2024-09-22T03:11:42.437908+0000","last_clean":"2024-09-22T03:11:42.437908+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:11:42.437908+0000","last_undegraded":"2024-09-22T03:11:42.437908+0000","last_fullsized":"2024-09-22T03:11:42.437908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"50'1383","reported_seq":1396,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.187857+0000","last_change":"2024-09-22T03:11:41.577187+0000","last_active":"2024-09-22T03:13:11.187857+0000","last_peered":"2024-09-22T03:13:11.187857+0000","last_clean":"2024-09-22T03:13:11.187857+0000","last_became_active":"2024-09-22T03:11:41.553906+0000","last_became_peered":"2024-09-22T03:11:41.553906+0000","last_unstale":"2024-09-22T03:13:11.187857+0000","last_undegraded":"2024-09-22T03:13:11.187857+0000","last_fullsized":"2024-09-22T03:13:11.187857+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1383,"log_dups_size":0,"ondisk_log_size":1383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11337728,"num_objects":173,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":11072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":126,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.433377+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:11:42.433377+0000","last_peered":"2024-09-22T03:11:42.433377+0000","last_clean":"2024-09-22T03:11:42.433377+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:11:42.433377+0000","last_undegraded":"2024-09-22T03:11:42.433377+0000","last_fullsized":"2024-09-22T03:11:42.433377+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"50'1575","reported_seq":1588,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.528590+0000","last_change":"2024-09-22T03:11:41.534290+0000","last_active":"2024-09-22T03:13:11.528590+0000","last_peered":"2024-09-22T03:13:11.528590+0000","last_clean":"2024-09-22T03:13:11.528590+0000","last_became_active":"2024-09-22T03:11:41.529404+0000","last_became_peered":"2024-09-22T03:11:41.529404+0000","last_unstale":"2024-09-22T03:13:11.528590+0000","last_undegraded":"2024-09-22T03:13:11.528590+0000","last_fullsized":"2024-09-22T03:13:11.528590+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1576,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":125,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.437423+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:11:42.437423+0000","last_peered":"2024-09-22T03:11:42.437423+0000","last_clean":"2024-09-22T03:11:42.437423+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:11:42.437423+0000","last_undegraded":"2024-09-22T03:11:42.437423+0000","last_fullsized":"2024-09-22T03:11:42.437423+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441374+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:11:42.441374+0000","last_peered":"2024-09-22T03:11:42.441374+0000","last_clean":"2024-09-22T03:11:42.441374+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:11:42.441374+0000","last_undegraded":"2024-09-22T03:11:42.441374+0000","last_fullsized":"2024-09-22T03:11:42.441374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"50'1575","reported_seq":1588,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:10.630006+0000","last_change":"2024-09-22T03:11:41.531581+0000","last_active":"2024-09-22T03:13:10.630006+0000","last_peered":"2024-09-22T03:13:10.630006+0000","last_clean":"2024-09-22T03:13:10.630006+0000","last_became_active":"2024-09-22T03:11:41.525831+0000","last_became_peered":"2024-09-22T03:11:41.525831+0000","last_unstale":"2024-09-22T03:13:10.630006+0000","last_undegraded":"2024-09-22T03:13:10.630006+0000","last_fullsized":"2024-09-22T03:13:10.630006+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1576,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.439011+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:11:42.439011+0000","last_peered":"2024-09-22T03:11:42.439011+0000","last_clean":"2024-09-22T03:11:42.439011+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:11:42.439011+0000","last_undegraded":"2024-09-22T03:11:42.439011+0000","last_fullsized":"2024-09-22T03:11:42.439011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"50'1399","reported_seq":1412,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.384333+0000","last_change":"2024-09-22T03:11:41.533626+0000","last_active":"2024-09-22T03:13:11.384333+0000","last_peered":"2024-09-22T03:13:11.384333+0000","last_clean":"2024-09-22T03:13:11.384333+0000","last_became_active":"2024-09-22T03:11:41.527097+0000","last_became_peered":"2024-09-22T03:11:41.527097+0000","last_unstale":"2024-09-22T03:13:11.384333+0000","last_undegraded":"2024-09-22T03:13:11.384333+0000","last_fullsized":"2024-09-22T03:13:11.384333+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1400,"num_write_kb":11200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.438284+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:11:42.438284+0000","last_peered":"2024-09-22T03:11:42.438284+0000","last_clean":"2024-09-22T03:11:42.438284+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:11:42.438284+0000","last_undegraded":"2024-09-22T03:11:42.438284+0000","last_fullsized":"2024-09-22T03:11:42.438284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"50'1627","reported_seq":1640,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:11.748539+0000","last_change":"2024-09-22T03:11:41.522320+0000","last_active":"2024-09-22T03:13:11.748539+0000","last_peered":"2024-09-22T03:13:11.748539+0000","last_clean":"2024-09-22T03:13:11.748539+0000","last_became_active":"2024-09-22T03:11:41.514872+0000","last_became_peered":"2024-09-22T03:11:41.514872+0000","last_unstale":"2024-09-22T03:13:11.748539+0000","last_undegraded":"2024-09-22T03:13:11.748539+0000","last_fullsized":"2024-09-22T03:13:11.748539+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1627,"log_dups_size":0,"ondisk_log_size":1627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13336576,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1628,"num_write_kb":13024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.442945+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:11:42.442945+0000","last_peered":"2024-09-22T03:11:42.442945+0000","last_clean":"2024-09-22T03:11:42.442945+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:11:42.442945+0000","last_undegraded":"2024-09-22T03:11:42.442945+0000","last_fullsized":"2024-09-22T03:11:42.442945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"50'1655","reported_seq":1668,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:13:10.001151+0000","last_change":"2024-09-22T03:11:41.514921+0000","last_active":"2024-09-22T03:13:10.001151+0000","last_peered":"2024-09-22T03:13:10.001151+0000","last_clean":"2024-09-22T03:13:10.001151+0000","last_became_active":"2024-09-22T03:11:41.509520+0000","last_became_peered":"2024-09-22T03:11:41.509520+0000","last_unstale":"2024-09-22T03:13:10.001151+0000","last_undegraded":"2024-09-22T03:13:10.001151+0000","last_fullsized":"2024-09-22T03:13:10.001151+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:11:40.416475+0000","last_clean_scrub_stamp":"2024-09-22T03:11:40.416475+0000","objects_scrubbed":0,"log_size":1655,"log_dups_size":0,"ondisk_log_size":1655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13565952,"num_objects":207,"num_object_clones":0,"num_object_copies":621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1656,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:11:42.441783+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:11:42.441783+0000","last_peered":"2024-09-22T03:11:42.441783+0000","last_clean":"2024-09-22T03:11:42.441783+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:11:42.441783+0000","last_undegraded":"2024-09-22T03:11:42.441783+0000","last_fullsized":"2024-09-22T03:11:42.441783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":207134720,"num_objects":3162,"num_object_clones":0,"num_object_copies":9486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25285,"num_write_kb":202280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":310358016,"data_stored":620716032,"data_compressed":32047797,"data_compressed_allocated":310358016,"data_compressed_original":620716032,"omap_allocated":0,"internal_metadata":0},"log_size":25269,"ondisk_log_size":25269,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154568,"kb_used_data":94964,"kb_used_omap":0,"kb_used_meta":59584,"kb_avail":94217272,"statfs":{"total":96636764160,"available":96478486528,"internally_reserved":0,"allocated":97243136,"data_stored":193771616,"data_compressed":9996558,"data_compressed_allocated":96808960,"data_compressed_original":193617920,"omap_allocated":0,"internal_metadata":61014016},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97764,"kb_used_data":56788,"kb_used_omap":0,"kb_used_meta":40960,"kb_avail":94274076,"statfs":{"total":96636764160,"available":96536653824,"internally_reserved":0,"allocated":58150912,"data_stored":116054656,"data_compressed":5983446,"data_compressed_allocated":57696256,"data_compressed_original":115884032,"omap_allocated":0,"internal_metadata":41943040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134128,"kb_used_data":83868,"kb_used_omap":0,"kb_used_meta":50240,"kb_avail":94237712,"statfs":{"total":96636764160,"available":96499417088,"internally_reserved":0,"allocated":85880832,"data_stored":171514496,"data_compressed":8846907,"data_compressed_allocated":85426176,"data_compressed_original":171343872,"omap_allocated":0,"internal_metadata":51445760},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122320,"kb_used_data":67968,"kb_used_omap":0,"kb_used_meta":54336,"kb_avail":94249520,"statfs":{"total":96636764160,"available":96511508480,"internally_reserved":0,"allocated":69599232,"data_stored":138959469,"data_compressed":7166100,"data_compressed_allocated":69148672,"data_compressed_original":138788864,"omap_allocated":0,"internal_metadata":55640064},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69451776,"data_stored":138903552,"data_compressed":7171672,"data_compressed_allocated":69451776,"data_compressed_original":138903552,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85839872,"data_stored":171679744,"data_compressed":8863900,"data_compressed_allocated":85839872,"data_compressed_original":171679744,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57884672,"data_stored":115769344,"data_compressed":5977174,"data_compressed_allocated":57884672,"data_compressed_original":115769344,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97181696,"data_stored":194363392,"data_compressed":10035051,"data_compressed_allocated":97181696,"data_compressed_original":194363392,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:13:14.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:15.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:15.126+0000 7f52b9357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:15.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:15.132+0000 7f52b9357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:17.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:17.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:17.641+0000 7fab35597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:17.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:17.647+0000 7fab35597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:18.713 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:13:18.787 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:13:18.787 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:13:18.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:13:18.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:18.935+0000 7f4b05cce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:18.945+0000 7f4b05cce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:18.984 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:18.984 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:18.984 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:18.984 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:18.985 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:18.985 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:18.985 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:18.985 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:18.985 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:18.985 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:18.985 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:18.985 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:18.988 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:18.989 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:18.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:13:19.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:19.110+0000 7f48b10a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:19.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:19.120+0000 7f48b10a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:19.138 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:19.138 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:19.139 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:19.139 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:19.139 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:19.139 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:19.139 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:19.139 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:19.139 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:19.139 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:19.139 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:19.139 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:19.142 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:19.142 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:19.142 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:13:19.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:19.268+0000 7f49b2d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:19.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:19.279+0000 7f49b2d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:19.341 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:19.341 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:19.341 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:19.341 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:19.341 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:19.341 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:19.341 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:19.346 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:19.346 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:19.346 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:13:19.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:19.481+0000 7f6f1e8b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:19.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:19.492+0000 7f6f1e8b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:19.562 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:19.562 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:19.562 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:19.562 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:19.562 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:19.562 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:19.562 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:19.562 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:19.562 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:19.562 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:19.563 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:19.563 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:19.565 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:19.565 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:19.905 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:20.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:20.039+0000 7f55504fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:20.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:20.045+0000 7f55504fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:22.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:22.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:22.464+0000 7f1ef4f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:22.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:22.471+0000 7f1ef4f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:24.296 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Removed 3187 objects 2024-09-22T03:13:24.296 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Clean up completed and total clean up time :10.7592 2024-09-22T03:13:24.566 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:13:24.567 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:13:24.567 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:13:24.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:13:24.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:24.668+0000 7f23bccb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:24.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:24.675+0000 7f23bccb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:24.692 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:24.693 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:24.693 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:13:24.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:24.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:24.793+0000 7fa193517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:24.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:24.801+0000 7fa193517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:24.817 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:24.817 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:24.817 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:24.817 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:24.817 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:24.818 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:24.818 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:24.818 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:24.818 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:24.818 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:24.818 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:24.818 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:24.820 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:24.820 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:24.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:13:24.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:24.839+0000 7fb094eb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:24.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:24.844+0000 7fb094eb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:24.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:24.924+0000 7fadb9757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:24.933+0000 7fadb9757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:24.947 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:24.947 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:24.947 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:24.947 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:24.947 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:24.947 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:24.947 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:24.947 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:24.948 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:24.948 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:24.948 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:24.948 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:24.950 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:24.950 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:24.950 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:13:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:25.090+0000 7f5c8fd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:25.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:25.098+0000 7f5c8fd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:25.112 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:25.112 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:25.112 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:25.112 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:25.112 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:25.112 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:25.115 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:25.116 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:26.174 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2024-09-22T03:13:26.174 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-09-22T03:13:26.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:26.283+0000 7f7b7eed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:26.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:26.294+0000 7f7b7eed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:26.918 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:27.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:27.017+0000 7f9ccfea9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:27.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:27.022+0000 7f9ccfea9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_4' removed 2024-09-22T03:13:27.466 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:13:27.467 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:13:27.467 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_5 2024-09-22T03:13:27.467 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_5 16 2024-09-22T03:13:27.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:27.592+0000 7fe6cb22c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:27.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:27.603+0000 7fe6cb22c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:28.447 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_5' created 2024-09-22T03:13:28.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_5 rados --yes-i-really-mean-it || true 2024-09-22T03:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:28.584+0000 7f28b9997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:28.596+0000 7f28b9997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:29.097 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:29.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:29.197+0000 7ff3d9058640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:29.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:29.201+0000 7ff3d9058640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:29.455 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rados' on pool 'unique_pool_5' 2024-09-22T03:13:30.117 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:13:30.117 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:13:30.117 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:13:30.117 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:13:30.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:30.217+0000 7f0466d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:30.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:30.225+0000 7f0466d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:30.239 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:30.239 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:30.239 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:30.239 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:30.240 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:30.240 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:30.240 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:30.240 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:30.240 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:30.240 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:30.240 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:30.240 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:30.242 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:30.242 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:30.243 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:13:30.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:30.339+0000 7fa679c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:30.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:30.347+0000 7fa679c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:30.361 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:30.361 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:30.361 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:30.362 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:30.362 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:30.362 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:30.362 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:30.362 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:30.362 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:30.362 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:30.362 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:30.362 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:30.364 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:30.364 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:30.365 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:13:30.472 DEBUG:teuthology.orchestra.run.smithi134:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_5 bench 90 write' 2024-09-22T03:13:30.474 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:13:30.474 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:13:30.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:30.470+0000 7f27d2797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:30.478+0000 7f27d2797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:30.494 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:30.494 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:30.495 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:30.495 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:30.495 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:30.495 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:30.495 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:30.495 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:30.495 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:30.495 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:30.495 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:30.495 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:30.497 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:30.498 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:30.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:13:30.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:hints = 1 2024-09-22T03:13:30.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:13:30.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object prefix: benchmark_data_smithi134_52486 2024-09-22T03:13:30.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:13:30.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:13:30.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:30.670+0000 7f6611597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:30.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:30.687+0000 7f6611597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:30.737 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:30.737 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:30.737 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:30.737 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:30.737 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:30.738 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:30.738 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:30.738 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:30.738 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:30.738 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:30.738 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:30.738 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:30.741 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:30.742 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:31.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:31.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:31.425+0000 7fe38166c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:31.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:31.431+0000 7fe38166c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:31.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 1 16 344 328 2.56236 2.5625 0.0390959 0.047436 2024-09-22T03:13:32.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 2 16 673 657 2.56623 2.57031 0.0338961 0.0481528 2024-09-22T03:13:33.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 3 16 1013 997 2.59617 2.65625 0.0455455 0.0477368 2024-09-22T03:13:33.642 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:33.771+0000 7f89fb997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:33.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:33.777+0000 7f89fb997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:34.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 4 16 1351 1335 2.60724 2.64062 0.0386767 0.0476491 2024-09-22T03:13:35.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 5 16 1704 1688 2.63731 2.75781 0.0848693 0.0470609 2024-09-22T03:13:35.742 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:13:35.742 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:13:35.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:13:35.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:35.878+0000 7fd2cea58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:35.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:35.888+0000 7fd2cea58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:35.921 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:36.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:36.082+0000 7f7ad9c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:36.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:36.091+0000 7f7ad9c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:36.175 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:13:36.176 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:13:36.192 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-22T03:13:34.788937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2515507,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":374,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":324,"ondisk_log_size":324,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":188676,"kb_used_data":4292,"kb_used_omap":0,"kb_used_meta":184320,"kb_avail":377298684,"statfs":{"total":386547056640,"available":386353852416,"internally_reserved":0,"allocated":4395008,"data_stored":7116324,"data_compressed":330598,"data_compressed_allocated":2461696,"data_compressed_original":6397952,"omap_allocated":0,"internal_metadata":188743680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1925120,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":1880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.341169"},"pg_stats":[{"pgid":"8.7","version":"54'31","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:31.653888+0000","last_change":"2024-09-22T03:13:29.529991+0000","last_active":"2024-09-22T03:13:31.653888+0000","last_peered":"2024-09-22T03:13:31.653888+0000","last_clean":"2024-09-22T03:13:31.653888+0000","last_became_active":"2024-09-22T03:13:29.525739+0000","last_became_peered":"2024-09-22T03:13:29.525739+0000","last_unstale":"2024-09-22T03:13:31.653888+0000","last_undegraded":"2024-09-22T03:13:31.653888+0000","last_fullsized":"2024-09-22T03:13:31.653888+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"54'31","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:31.292670+0000","last_change":"2024-09-22T03:13:29.531031+0000","last_active":"2024-09-22T03:13:31.292670+0000","last_peered":"2024-09-22T03:13:31.292670+0000","last_clean":"2024-09-22T03:13:31.292670+0000","last_became_active":"2024-09-22T03:13:29.526121+0000","last_became_peered":"2024-09-22T03:13:29.526121+0000","last_unstale":"2024-09-22T03:13:31.292670+0000","last_undegraded":"2024-09-22T03:13:31.292670+0000","last_fullsized":"2024-09-22T03:13:31.292670+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"54'26","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:31.760062+0000","last_change":"2024-09-22T03:13:29.558419+0000","last_active":"2024-09-22T03:13:31.760062+0000","last_peered":"2024-09-22T03:13:31.760062+0000","last_clean":"2024-09-22T03:13:31.760062+0000","last_became_active":"2024-09-22T03:13:29.554453+0000","last_became_peered":"2024-09-22T03:13:29.554453+0000","last_unstale":"2024-09-22T03:13:31.760062+0000","last_undegraded":"2024-09-22T03:13:31.760062+0000","last_fullsized":"2024-09-22T03:13:31.760062+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221184,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466139+0000","last_change":"2024-09-22T03:13:29.576486+0000","last_active":"2024-09-22T03:13:30.466139+0000","last_peered":"2024-09-22T03:13:30.466139+0000","last_clean":"2024-09-22T03:13:30.466139+0000","last_became_active":"2024-09-22T03:13:29.572229+0000","last_became_peered":"2024-09-22T03:13:29.572229+0000","last_unstale":"2024-09-22T03:13:30.466139+0000","last_undegraded":"2024-09-22T03:13:30.466139+0000","last_fullsized":"2024-09-22T03:13:30.466139+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"54'7","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.922342+0000","last_change":"2024-09-22T03:13:29.555891+0000","last_active":"2024-09-22T03:13:30.922342+0000","last_peered":"2024-09-22T03:13:30.922342+0000","last_clean":"2024-09-22T03:13:30.922342+0000","last_became_active":"2024-09-22T03:13:29.530274+0000","last_became_peered":"2024-09-22T03:13:29.530274+0000","last_unstale":"2024-09-22T03:13:30.922342+0000","last_undegraded":"2024-09-22T03:13:30.922342+0000","last_fullsized":"2024-09-22T03:13:30.922342+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.462357+0000","last_change":"2024-09-22T03:13:29.535751+0000","last_active":"2024-09-22T03:13:30.462357+0000","last_peered":"2024-09-22T03:13:30.462357+0000","last_clean":"2024-09-22T03:13:30.462357+0000","last_became_active":"2024-09-22T03:13:29.528896+0000","last_became_peered":"2024-09-22T03:13:29.528896+0000","last_unstale":"2024-09-22T03:13:30.462357+0000","last_undegraded":"2024-09-22T03:13:30.462357+0000","last_fullsized":"2024-09-22T03:13:30.462357+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"54'7","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.709727+0000","last_change":"2024-09-22T03:13:29.533410+0000","last_active":"2024-09-22T03:13:30.709727+0000","last_peered":"2024-09-22T03:13:30.709727+0000","last_clean":"2024-09-22T03:13:30.709727+0000","last_became_active":"2024-09-22T03:13:29.524152+0000","last_became_peered":"2024-09-22T03:13:29.524152+0000","last_unstale":"2024-09-22T03:13:30.709727+0000","last_undegraded":"2024-09-22T03:13:30.709727+0000","last_fullsized":"2024-09-22T03:13:30.709727+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"54'31","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:31.560423+0000","last_change":"2024-09-22T03:13:29.574097+0000","last_active":"2024-09-22T03:13:31.560423+0000","last_peered":"2024-09-22T03:13:31.560423+0000","last_clean":"2024-09-22T03:13:31.560423+0000","last_became_active":"2024-09-22T03:13:29.566300+0000","last_became_peered":"2024-09-22T03:13:29.566300+0000","last_unstale":"2024-09-22T03:13:31.560423+0000","last_undegraded":"2024-09-22T03:13:31.560423+0000","last_fullsized":"2024-09-22T03:13:31.560423+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466914+0000","last_change":"2024-09-22T03:13:29.560741+0000","last_active":"2024-09-22T03:13:30.466914+0000","last_peered":"2024-09-22T03:13:30.466914+0000","last_clean":"2024-09-22T03:13:30.466914+0000","last_became_active":"2024-09-22T03:13:29.557303+0000","last_became_peered":"2024-09-22T03:13:29.557303+0000","last_unstale":"2024-09-22T03:13:30.466914+0000","last_undegraded":"2024-09-22T03:13:30.466914+0000","last_fullsized":"2024-09-22T03:13:30.466914+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"54'31","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:31.694820+0000","last_change":"2024-09-22T03:13:29.549832+0000","last_active":"2024-09-22T03:13:31.694820+0000","last_peered":"2024-09-22T03:13:31.694820+0000","last_clean":"2024-09-22T03:13:31.694820+0000","last_became_active":"2024-09-22T03:13:29.525112+0000","last_became_peered":"2024-09-22T03:13:29.525112+0000","last_unstale":"2024-09-22T03:13:31.694820+0000","last_undegraded":"2024-09-22T03:13:31.694820+0000","last_fullsized":"2024-09-22T03:13:31.694820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.467462+0000","last_change":"2024-09-22T03:13:29.556621+0000","last_active":"2024-09-22T03:13:30.467462+0000","last_peered":"2024-09-22T03:13:30.467462+0000","last_clean":"2024-09-22T03:13:30.467462+0000","last_became_active":"2024-09-22T03:13:29.551982+0000","last_became_peered":"2024-09-22T03:13:29.551982+0000","last_unstale":"2024-09-22T03:13:30.467462+0000","last_undegraded":"2024-09-22T03:13:30.467462+0000","last_fullsized":"2024-09-22T03:13:30.467462+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"54'7","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:31.327415+0000","last_change":"2024-09-22T03:13:29.548744+0000","last_active":"2024-09-22T03:13:31.327415+0000","last_peered":"2024-09-22T03:13:31.327415+0000","last_clean":"2024-09-22T03:13:31.327415+0000","last_became_active":"2024-09-22T03:13:29.542670+0000","last_became_peered":"2024-09-22T03:13:29.542670+0000","last_unstale":"2024-09-22T03:13:31.327415+0000","last_undegraded":"2024-09-22T03:13:31.327415+0000","last_fullsized":"2024-09-22T03:13:31.327415+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"54'15","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.652046+0000","last_change":"2024-09-22T03:13:29.547139+0000","last_active":"2024-09-22T03:13:30.652046+0000","last_peered":"2024-09-22T03:13:30.652046+0000","last_clean":"2024-09-22T03:13:30.652046+0000","last_became_active":"2024-09-22T03:13:29.541888+0000","last_became_peered":"2024-09-22T03:13:29.541888+0000","last_unstale":"2024-09-22T03:13:30.652046+0000","last_undegraded":"2024-09-22T03:13:30.652046+0000","last_fullsized":"2024-09-22T03:13:30.652046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"54'7","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.687027+0000","last_change":"2024-09-22T03:13:29.587411+0000","last_active":"2024-09-22T03:13:30.687027+0000","last_peered":"2024-09-22T03:13:30.687027+0000","last_clean":"2024-09-22T03:13:30.687027+0000","last_became_active":"2024-09-22T03:13:29.583366+0000","last_became_peered":"2024-09-22T03:13:29.583366+0000","last_unstale":"2024-09-22T03:13:30.687027+0000","last_undegraded":"2024-09-22T03:13:30.687027+0000","last_fullsized":"2024-09-22T03:13:30.687027+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'31","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:31.508131+0000","last_change":"2024-09-22T03:13:29.528163+0000","last_active":"2024-09-22T03:13:31.508131+0000","last_peered":"2024-09-22T03:13:31.508131+0000","last_clean":"2024-09-22T03:13:31.508131+0000","last_became_active":"2024-09-22T03:13:29.521737+0000","last_became_peered":"2024-09-22T03:13:29.521737+0000","last_unstale":"2024-09-22T03:13:31.508131+0000","last_undegraded":"2024-09-22T03:13:31.508131+0000","last_fullsized":"2024-09-22T03:13:31.508131+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466531+0000","last_change":"2024-09-22T03:13:29.566804+0000","last_active":"2024-09-22T03:13:30.466531+0000","last_peered":"2024-09-22T03:13:30.466531+0000","last_clean":"2024-09-22T03:13:30.466531+0000","last_became_active":"2024-09-22T03:13:29.560558+0000","last_became_peered":"2024-09-22T03:13:29.560558+0000","last_unstale":"2024-09-22T03:13:30.466531+0000","last_undegraded":"2024-09-22T03:13:30.466531+0000","last_fullsized":"2024-09-22T03:13:30.466531+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":1925120,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":1880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3907584,"data_stored":7815168,"data_compressed":402270,"data_compressed_allocated":3907584,"data_compressed_original":7815168,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56624,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":55424,"kb_avail":94315216,"statfs":{"total":96636764160,"available":96578781184,"internally_reserved":0,"allocated":1212416,"data_stored":1650555,"data_compressed":76324,"data_compressed_allocated":741376,"data_compressed_original":1482752,"omap_allocated":0,"internal_metadata":56754176},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33828,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":32640,"kb_avail":94338012,"statfs":{"total":96636764160,"available":96602124288,"internally_reserved":0,"allocated":1200128,"data_stored":2093467,"data_compressed":98670,"data_compressed_allocated":708608,"data_compressed_original":1908736,"omap_allocated":0,"internal_metadata":33423360},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47524,"kb_used_data":1428,"kb_used_omap":0,"kb_used_meta":46080,"kb_avail":94324316,"statfs":{"total":96636764160,"available":96588099584,"internally_reserved":0,"allocated":1462272,"data_stored":2617755,"data_compressed":125644,"data_compressed_allocated":970752,"data_compressed_original":2433024,"omap_allocated":0,"internal_metadata":47185920},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706218,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50700,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":50176,"kb_avail":94321140,"statfs":{"total":96636764160,"available":96584847360,"internally_reserved":0,"allocated":520192,"data_stored":754547,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":51380224},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":524288,"data_compressed":26934,"data_compressed_allocated":262144,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1486848,"data_stored":2973696,"data_compressed":153076,"data_compressed_allocated":1486848,"data_compressed_original":2973696,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":978944,"data_stored":1957888,"data_compressed":100782,"data_compressed_allocated":978944,"data_compressed_original":1957888,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1179648,"data_stored":2359296,"data_compressed":121478,"data_compressed_allocated":1179648,"data_compressed_original":2359296,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:13:36.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 6 16 2019 2003 2.60789 2.46094 0.0483944 0.0476738 2024-09-22T03:13:37.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 7 16 2354 2338 2.6092 2.61719 0.0996135 0.0475979 2024-09-22T03:13:38.218 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:38.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:38.346+0000 7f0aff597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:38.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:38.354+0000 7f0aff597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:38.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 8 16 2694 2678 2.61505 2.65625 0.0319063 0.0476705 2024-09-22T03:13:39.530 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 9 16 3039 3023 2.62395 2.69531 0.0325926 0.0473935 2024-09-22T03:13:40.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 10 16 3383 3367 2.63029 2.6875 0.0435595 0.0473952 2024-09-22T03:13:40.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:40.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:40.673+0000 7f83d026c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:40.680+0000 7f83d026c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:41.194 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:13:41.195 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:13:41.195 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:13:41.195 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:13:41.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:41.330+0000 7effedeb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:41.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:41.339+0000 7effedeb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:41.363 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:41.363 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:41.363 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:41.363 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:41.363 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:41.363 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:41.363 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:41.363 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:41.363 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:41.364 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:41.364 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:41.364 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:41.368 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:41.368 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:41.368 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:13:41.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 11 16 3707 3691 2.62127 2.53125 0.0924084 0.0475746 2024-09-22T03:13:41.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:41.523+0000 7f433630e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:41.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:41.535+0000 7f433630e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:41.562 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:41.562 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:41.562 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:41.562 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:41.563 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:41.563 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:41.563 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:41.563 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:41.563 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:41.563 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:41.563 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:41.563 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:41.565 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:41.566 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:41.566 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:13:41.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:41.688+0000 7fadc2ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:41.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:41.698+0000 7fadc2ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:41.724 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:41.724 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:41.724 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:41.724 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:41.724 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:41.724 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:41.724 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:41.724 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:41.725 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:41.725 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:41.725 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:41.725 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:41.727 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:41.728 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:41.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:13:41.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:41.856+0000 7f5100b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:41.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:41.866+0000 7f5100b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:41.888 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:41.888 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:41.888 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:41.888 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:41.888 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:41.889 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:41.889 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:41.889 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:41.889 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:41.889 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:41.889 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:41.889 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:41.892 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:41.892 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:42.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 12 16 4027 4011 2.61115 2.5 0.0254215 0.0477708 2024-09-22T03:13:42.825 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:42.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:42.969+0000 7fd4f9823640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:42.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:42.977+0000 7fd4f9823640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:43.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 13 16 4366 4350 2.614 2.64844 0.0209381 0.0477544 2024-09-22T03:13:44.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 14 16 4710 4694 2.61923 2.6875 0.0601082 0.0476531 2024-09-22T03:13:45.124 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:45.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:45.282+0000 7f9c2b30e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:45.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:45.288+0000 7f9c2b30e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:45.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 15 16 5038 5022 2.61543 2.5625 0.0577884 0.0477221 2024-09-22T03:13:46.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 16 16 5362 5346 2.61016 2.53125 0.0709666 0.0477344 2024-09-22T03:13:46.893 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:13:46.893 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:13:46.894 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:13:46.894 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:13:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:47.031+0000 7fc34a157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:47.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:47.042+0000 7fc34a157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:47.100 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:47.100 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:47.100 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:47.100 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:47.100 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:47.100 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:47.100 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:47.100 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:47.101 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:47.101 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:47.101 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:47.101 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:47.104 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:47.104 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:47.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:13:47.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:47.257+0000 7fda3a597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:47.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:47.268+0000 7fda3a597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:47.348 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:47.349 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:47.349 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:47.349 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:47.349 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:47.349 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:47.349 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:47.349 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:47.349 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:47.349 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:47.349 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:47.349 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:47.352 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:47.353 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:47.353 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:13:47.473 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:47.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:47.483+0000 7fb1a294e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:47.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:47.496+0000 7fb1a294e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:47.526 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:47.526 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:47.526 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:47.526 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:47.526 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:47.526 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:47.526 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:47.526 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:47.526 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:47.526 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:47.527 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:47.527 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:47.530 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:47.531 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:47.531 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:13:47.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 17 16 5651 5635 2.58942 2.25781 0.0558665 0.0481992 2024-09-22T03:13:47.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:47.614+0000 7f9e6a858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:47.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:47.622+0000 7f9e6a858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:47.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:47.720+0000 7f9ca2557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:47.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:47.735+0000 7f9ca2557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:47.754 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:47.754 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:47.754 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:47.754 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:47.754 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:47.754 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:47.754 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:47.754 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:47.754 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:47.754 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:47.755 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:47.755 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:47.757 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:47.757 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:48.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 18 16 5940 5924 2.57099 2.25781 0.0414508 0.0485611 2024-09-22T03:13:49.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 19 16 6276 6260 2.57382 2.625 0.041194 0.0484687 2024-09-22T03:13:49.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:49.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:49.862+0000 7f15a9e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:49.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:49.869+0000 7f15a9e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:50.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:13:50.530878+0000 min lat: 0.00843874 max lat: 0.175624 avg lat: 0.0488281 2024-09-22T03:13:50.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:13:50.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 20 16 6554 6538 2.55372 2.17188 0.0667892 0.0488281 2024-09-22T03:13:51.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 21 16 6857 6841 2.54483 2.36719 0.0357673 0.0490707 2024-09-22T03:13:52.052 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:52.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:52.182+0000 7f2add397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:52.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:52.190+0000 7f2add397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:52.531 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 22 16 7169 7153 2.53994 2.4375 0.0727473 0.0491459 2024-09-22T03:13:52.758 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:13:52.758 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:13:52.758 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:13:52.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:13:52.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:52.881+0000 7ff8504d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:52.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:52.892+0000 7ff8504d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:52.918 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:52.921 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:52.921 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:52.921 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:13:53.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:53.067+0000 7fd5b7997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:53.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:53.076+0000 7fd5b7997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:53.156 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:53.156 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:53.156 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:53.156 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:53.156 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:53.158 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:53.159 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:53.159 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:13:53.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:53.310+0000 7f1143917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:53.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:53.321+0000 7f1143917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:53.417 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:53.417 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:53.417 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:53.417 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:53.417 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:53.417 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:53.418 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:53.418 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:53.418 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:53.418 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:53.418 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:53.418 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:53.422 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:53.422 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:53.422 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:13:53.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 23 16 7457 7441 2.52732 2.25 0.0535788 0.0493758 2024-09-22T03:13:53.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:53.568+0000 7fc62526c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:53.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:53.580+0000 7fc62526c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:53.604 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:13:53.604 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:13:53.604 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:13:53.604 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:13:53.604 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:13:53.604 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:13:53.605 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:13:53.605 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:13:53.605 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:13:53.605 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:13:53.605 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:13:53.605 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:13:53.608 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:13:53.609 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:13:54.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:54.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:54.476+0000 7f48bcf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:54.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:54.482+0000 7f48bcf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:54.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 24 16 7744 7728 2.51543 2.24219 0.0362382 0.0496047 2024-09-22T03:13:55.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 25 16 8078 8062 2.51918 2.60938 0.0517298 0.0495674 2024-09-22T03:13:56.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 26 16 8394 8378 2.51724 2.46875 0.0760594 0.0496209 2024-09-22T03:13:56.613 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:13:56.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:56.747+0000 7fa4a1b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:56.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:56.753+0000 7fa4a1b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:57.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 27 16 8679 8663 2.50647 2.22656 0.0747194 0.0497841 2024-09-22T03:13:58.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 28 16 8999 8983 2.50623 2.5 0.0416431 0.0498387 2024-09-22T03:13:58.610 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:13:58.610 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:13:58.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:13:58.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:58.729+0000 7f5f3806c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:58.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:58.740+0000 7f5f3806c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:58.965 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:13:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:13:58.969 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:13:58.990 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-22T03:13:58.792993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68452915,"num_objects":1040,"num_object_clones":0,"num_object_copies":3120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":8423,"num_write_kb":68168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8368,"ondisk_log_size":8368,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":319720,"kb_used_data":100648,"kb_used_omap":0,"kb_used_meta":219008,"kb_avail":377167640,"statfs":{"total":386547056640,"available":386219663360,"internally_reserved":0,"allocated":103063552,"data_stored":204440633,"data_compressed":10516884,"data_compressed_allocated":101122048,"data_compressed_original":203718656,"omap_allocated":0,"internal_metadata":224264192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27975680,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3415,"num_write_kb":27320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002121"},"pg_stats":[{"pgid":"8.7","version":"54'527","reported_seq":540,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:56.508168+0000","last_change":"2024-09-22T03:13:29.529991+0000","last_active":"2024-09-22T03:13:56.508168+0000","last_peered":"2024-09-22T03:13:56.508168+0000","last_clean":"2024-09-22T03:13:56.508168+0000","last_became_active":"2024-09-22T03:13:29.525739+0000","last_became_peered":"2024-09-22T03:13:29.525739+0000","last_unstale":"2024-09-22T03:13:56.508168+0000","last_undegraded":"2024-09-22T03:13:56.508168+0000","last_fullsized":"2024-09-22T03:13:56.508168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"54'543","reported_seq":556,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:56.139295+0000","last_change":"2024-09-22T03:13:29.531031+0000","last_active":"2024-09-22T03:13:56.139295+0000","last_peered":"2024-09-22T03:13:56.139295+0000","last_clean":"2024-09-22T03:13:56.139295+0000","last_became_active":"2024-09-22T03:13:29.526121+0000","last_became_peered":"2024-09-22T03:13:29.526121+0000","last_unstale":"2024-09-22T03:13:56.139295+0000","last_undegraded":"2024-09-22T03:13:56.139295+0000","last_fullsized":"2024-09-22T03:13:56.139295+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"54'423","reported_seq":436,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:56.186793+0000","last_change":"2024-09-22T03:13:29.558419+0000","last_active":"2024-09-22T03:13:56.186793+0000","last_peered":"2024-09-22T03:13:56.186793+0000","last_clean":"2024-09-22T03:13:56.186793+0000","last_became_active":"2024-09-22T03:13:29.554453+0000","last_became_peered":"2024-09-22T03:13:29.554453+0000","last_unstale":"2024-09-22T03:13:56.186793+0000","last_undegraded":"2024-09-22T03:13:56.186793+0000","last_fullsized":"2024-09-22T03:13:56.186793+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'485","reported_seq":498,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:55.755095+0000","last_change":"2024-09-22T03:13:29.576486+0000","last_active":"2024-09-22T03:13:55.755095+0000","last_peered":"2024-09-22T03:13:55.755095+0000","last_clean":"2024-09-22T03:13:55.755095+0000","last_became_active":"2024-09-22T03:13:29.572229+0000","last_became_peered":"2024-09-22T03:13:29.572229+0000","last_unstale":"2024-09-22T03:13:55.755095+0000","last_undegraded":"2024-09-22T03:13:55.755095+0000","last_fullsized":"2024-09-22T03:13:55.755095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3981312,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":486,"num_write_kb":3888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"54'503","reported_seq":516,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:55.324660+0000","last_change":"2024-09-22T03:13:29.555891+0000","last_active":"2024-09-22T03:13:55.324660+0000","last_peered":"2024-09-22T03:13:55.324660+0000","last_clean":"2024-09-22T03:13:55.324660+0000","last_became_active":"2024-09-22T03:13:29.530274+0000","last_became_peered":"2024-09-22T03:13:29.530274+0000","last_unstale":"2024-09-22T03:13:55.324660+0000","last_undegraded":"2024-09-22T03:13:55.324660+0000","last_fullsized":"2024-09-22T03:13:55.324660+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"54'519","reported_seq":532,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:55.451842+0000","last_change":"2024-09-22T03:13:29.535751+0000","last_active":"2024-09-22T03:13:55.451842+0000","last_peered":"2024-09-22T03:13:55.451842+0000","last_clean":"2024-09-22T03:13:55.451842+0000","last_became_active":"2024-09-22T03:13:29.528896+0000","last_became_peered":"2024-09-22T03:13:29.528896+0000","last_unstale":"2024-09-22T03:13:55.451842+0000","last_undegraded":"2024-09-22T03:13:55.451842+0000","last_fullsized":"2024-09-22T03:13:55.451842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"54'543","reported_seq":556,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:56.555844+0000","last_change":"2024-09-22T03:13:29.533410+0000","last_active":"2024-09-22T03:13:56.555844+0000","last_peered":"2024-09-22T03:13:56.555844+0000","last_clean":"2024-09-22T03:13:56.555844+0000","last_became_active":"2024-09-22T03:13:29.524152+0000","last_became_peered":"2024-09-22T03:13:29.524152+0000","last_unstale":"2024-09-22T03:13:56.555844+0000","last_undegraded":"2024-09-22T03:13:56.555844+0000","last_fullsized":"2024-09-22T03:13:56.555844+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"54'567","reported_seq":580,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:56.557449+0000","last_change":"2024-09-22T03:13:29.574097+0000","last_active":"2024-09-22T03:13:56.557449+0000","last_peered":"2024-09-22T03:13:56.557449+0000","last_clean":"2024-09-22T03:13:56.557449+0000","last_became_active":"2024-09-22T03:13:29.566300+0000","last_became_peered":"2024-09-22T03:13:29.566300+0000","last_unstale":"2024-09-22T03:13:56.557449+0000","last_undegraded":"2024-09-22T03:13:56.557449+0000","last_fullsized":"2024-09-22T03:13:56.557449+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"54'575","reported_seq":588,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:55.653268+0000","last_change":"2024-09-22T03:13:29.560741+0000","last_active":"2024-09-22T03:13:55.653268+0000","last_peered":"2024-09-22T03:13:55.653268+0000","last_clean":"2024-09-22T03:13:55.653268+0000","last_became_active":"2024-09-22T03:13:29.557303+0000","last_became_peered":"2024-09-22T03:13:29.557303+0000","last_unstale":"2024-09-22T03:13:55.653268+0000","last_undegraded":"2024-09-22T03:13:55.653268+0000","last_fullsized":"2024-09-22T03:13:55.653268+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"54'557","reported_seq":570,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:56.753737+0000","last_change":"2024-09-22T03:13:29.549832+0000","last_active":"2024-09-22T03:13:56.753737+0000","last_peered":"2024-09-22T03:13:56.753737+0000","last_clean":"2024-09-22T03:13:56.753737+0000","last_became_active":"2024-09-22T03:13:29.525112+0000","last_became_peered":"2024-09-22T03:13:29.525112+0000","last_unstale":"2024-09-22T03:13:56.753737+0000","last_undegraded":"2024-09-22T03:13:56.753737+0000","last_fullsized":"2024-09-22T03:13:56.753737+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4571136,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"54'423","reported_seq":436,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:54.681732+0000","last_change":"2024-09-22T03:13:29.556621+0000","last_active":"2024-09-22T03:13:54.681732+0000","last_peered":"2024-09-22T03:13:54.681732+0000","last_clean":"2024-09-22T03:13:54.681732+0000","last_became_active":"2024-09-22T03:13:29.551982+0000","last_became_peered":"2024-09-22T03:13:29.551982+0000","last_unstale":"2024-09-22T03:13:54.681732+0000","last_undegraded":"2024-09-22T03:13:54.681732+0000","last_fullsized":"2024-09-22T03:13:54.681732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"54'479","reported_seq":492,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:55.241838+0000","last_change":"2024-09-22T03:13:29.548744+0000","last_active":"2024-09-22T03:13:55.241838+0000","last_peered":"2024-09-22T03:13:55.241838+0000","last_clean":"2024-09-22T03:13:55.241838+0000","last_became_active":"2024-09-22T03:13:29.542670+0000","last_became_peered":"2024-09-22T03:13:29.542670+0000","last_unstale":"2024-09-22T03:13:55.241838+0000","last_undegraded":"2024-09-22T03:13:55.241838+0000","last_fullsized":"2024-09-22T03:13:55.241838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"54'511","reported_seq":524,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:54.369690+0000","last_change":"2024-09-22T03:13:29.547139+0000","last_active":"2024-09-22T03:13:54.369690+0000","last_peered":"2024-09-22T03:13:54.369690+0000","last_clean":"2024-09-22T03:13:54.369690+0000","last_became_active":"2024-09-22T03:13:29.541888+0000","last_became_peered":"2024-09-22T03:13:29.541888+0000","last_unstale":"2024-09-22T03:13:54.369690+0000","last_undegraded":"2024-09-22T03:13:54.369690+0000","last_fullsized":"2024-09-22T03:13:54.369690+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"54'535","reported_seq":548,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:55.722535+0000","last_change":"2024-09-22T03:13:29.587411+0000","last_active":"2024-09-22T03:13:55.722535+0000","last_peered":"2024-09-22T03:13:55.722535+0000","last_clean":"2024-09-22T03:13:55.722535+0000","last_became_active":"2024-09-22T03:13:29.583366+0000","last_became_peered":"2024-09-22T03:13:29.583366+0000","last_unstale":"2024-09-22T03:13:55.722535+0000","last_undegraded":"2024-09-22T03:13:55.722535+0000","last_fullsized":"2024-09-22T03:13:55.722535+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'583","reported_seq":596,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:56.233399+0000","last_change":"2024-09-22T03:13:29.528163+0000","last_active":"2024-09-22T03:13:56.233399+0000","last_peered":"2024-09-22T03:13:56.233399+0000","last_clean":"2024-09-22T03:13:56.233399+0000","last_became_active":"2024-09-22T03:13:29.521737+0000","last_became_peered":"2024-09-22T03:13:29.521737+0000","last_unstale":"2024-09-22T03:13:56.233399+0000","last_undegraded":"2024-09-22T03:13:56.233399+0000","last_fullsized":"2024-09-22T03:13:56.233399+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"54'495","reported_seq":508,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:54.839779+0000","last_change":"2024-09-22T03:13:29.566804+0000","last_active":"2024-09-22T03:13:54.839779+0000","last_peered":"2024-09-22T03:13:54.839779+0000","last_clean":"2024-09-22T03:13:54.839779+0000","last_became_active":"2024-09-22T03:13:29.560558+0000","last_became_peered":"2024-09-22T03:13:29.560558+0000","last_unstale":"2024-09-22T03:13:54.839779+0000","last_undegraded":"2024-09-22T03:13:54.839779+0000","last_fullsized":"2024-09-22T03:13:54.839779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":67862528,"num_objects":1036,"num_object_clones":0,"num_object_copies":3108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8284,"num_write_kb":66272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":102723584,"data_stored":205447168,"data_compressed":10605087,"data_compressed_allocated":102723584,"data_compressed_original":205447168,"omap_allocated":0,"internal_metadata":0},"log_size":8268,"ondisk_log_size":8268,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91260,"kb_used_data":26092,"kb_used_omap":0,"kb_used_meta":65152,"kb_avail":94280580,"statfs":{"total":96636764160,"available":96543313920,"internally_reserved":0,"allocated":26718208,"data_stored":52662139,"data_compressed":2709822,"data_compressed_allocated":26247168,"data_compressed_original":52494336,"omap_allocated":0,"internal_metadata":66715648},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55872,"kb_used_data":19056,"kb_used_omap":0,"kb_used_meta":36800,"kb_avail":94315968,"statfs":{"total":96636764160,"available":96579551232,"internally_reserved":0,"allocated":19513344,"data_stored":38719899,"data_compressed":1989474,"data_compressed_allocated":19021824,"data_compressed_original":38535168,"omap_allocated":0,"internal_metadata":37683200},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87808,"kb_used_data":29232,"kb_used_omap":0,"kb_used_meta":58560,"kb_avail":94284032,"statfs":{"total":96636764160,"available":96546848768,"internally_reserved":0,"allocated":29933568,"data_stored":59560347,"data_compressed":3065256,"data_compressed_allocated":29442048,"data_compressed_original":59375616,"omap_allocated":0,"internal_metadata":59965440},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706243,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84780,"kb_used_data":26268,"kb_used_omap":0,"kb_used_meta":58496,"kb_avail":94287060,"statfs":{"total":96636764160,"available":96549949440,"internally_reserved":0,"allocated":26898432,"data_stored":53498248,"data_compressed":2752332,"data_compressed_allocated":26411008,"data_compressed_original":53313536,"omap_allocated":0,"internal_metadata":59899904},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27000832,"data_stored":54001664,"data_compressed":2787514,"data_compressed_allocated":27000832,"data_compressed_original":54001664,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29855744,"data_stored":59711488,"data_compressed":3082249,"data_compressed_allocated":29855744,"data_compressed_original":59711488,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19202048,"data_stored":38404096,"data_compressed":1982356,"data_compressed_allocated":19202048,"data_compressed_original":38404096,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26664960,"data_stored":53329920,"data_compressed":2752968,"data_compressed_allocated":26664960,"data_compressed_original":53329920,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:13:59.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:59.110+0000 7f424e62c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:59.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:13:59.115+0000 7f424e62c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:13:59.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 29 16 9249 9233 2.48715 1.95312 0.0319058 0.0502072 2024-09-22T03:14:00.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 30 16 9523 9507 2.47559 2.14062 0.0373086 0.0503875 2024-09-22T03:14:01.309 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:01.460+0000 7ffb16f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:01.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:01.469+0000 7ffb16f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:01.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 31 16 9810 9794 2.46806 2.24219 0.045711 0.050597 2024-09-22T03:14:02.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 32 16 10103 10087 2.46246 2.28906 0.119788 0.0507118 2024-09-22T03:14:03.532 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 33 16 10393 10377 2.45649 2.26562 0.0312534 0.0508322 2024-09-22T03:14:03.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:03.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:03.808+0000 7fb0f40ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:03.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:03.816+0000 7fb0f40ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:03.992 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:14:03.993 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:14:03.993 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:14:04.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:04.137+0000 7f2420997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:04.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:04.148+0000 7f2420997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:04.473 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:14:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:14:04.491 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-22T03:14:02.793744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80749107,"num_objects":1228,"num_object_clones":0,"num_object_copies":3684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":9924,"num_write_kb":80176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9869,"ondisk_log_size":9869,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":352404,"kb_used_data":118036,"kb_used_omap":0,"kb_used_meta":234304,"kb_avail":377134956,"statfs":{"total":386547056640,"available":386186194944,"internally_reserved":0,"allocated":120868864,"data_stored":240051257,"data_compressed":12355665,"data_compressed_allocated":118927360,"data_compressed_original":239329280,"omap_allocated":0,"internal_metadata":239927296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31023104,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3787,"num_write_kb":30296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002123"},"pg_stats":[{"pgid":"8.7","version":"54'615","reported_seq":628,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:01.702496+0000","last_change":"2024-09-22T03:13:29.529991+0000","last_active":"2024-09-22T03:14:01.702496+0000","last_peered":"2024-09-22T03:14:01.702496+0000","last_clean":"2024-09-22T03:14:01.702496+0000","last_became_active":"2024-09-22T03:13:29.525739+0000","last_became_peered":"2024-09-22T03:13:29.525739+0000","last_unstale":"2024-09-22T03:14:01.702496+0000","last_undegraded":"2024-09-22T03:14:01.702496+0000","last_fullsized":"2024-09-22T03:14:01.702496+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"54'639","reported_seq":652,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:01.539989+0000","last_change":"2024-09-22T03:13:29.531031+0000","last_active":"2024-09-22T03:14:01.539989+0000","last_peered":"2024-09-22T03:14:01.539989+0000","last_clean":"2024-09-22T03:14:01.539989+0000","last_became_active":"2024-09-22T03:13:29.526121+0000","last_became_peered":"2024-09-22T03:13:29.526121+0000","last_unstale":"2024-09-22T03:14:01.539989+0000","last_undegraded":"2024-09-22T03:14:01.539989+0000","last_fullsized":"2024-09-22T03:14:01.539989+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"54'511","reported_seq":524,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:01.406362+0000","last_change":"2024-09-22T03:13:29.558419+0000","last_active":"2024-09-22T03:14:01.406362+0000","last_peered":"2024-09-22T03:14:01.406362+0000","last_clean":"2024-09-22T03:14:01.406362+0000","last_became_active":"2024-09-22T03:13:29.554453+0000","last_became_peered":"2024-09-22T03:13:29.554453+0000","last_unstale":"2024-09-22T03:14:01.406362+0000","last_undegraded":"2024-09-22T03:14:01.406362+0000","last_fullsized":"2024-09-22T03:14:01.406362+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'567","reported_seq":580,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:00.513727+0000","last_change":"2024-09-22T03:13:29.576486+0000","last_active":"2024-09-22T03:14:00.513727+0000","last_peered":"2024-09-22T03:14:00.513727+0000","last_clean":"2024-09-22T03:14:00.513727+0000","last_became_active":"2024-09-22T03:13:29.572229+0000","last_became_peered":"2024-09-22T03:13:29.572229+0000","last_unstale":"2024-09-22T03:14:00.513727+0000","last_undegraded":"2024-09-22T03:14:00.513727+0000","last_fullsized":"2024-09-22T03:14:00.513727+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"54'631","reported_seq":644,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:01.748929+0000","last_change":"2024-09-22T03:13:29.555891+0000","last_active":"2024-09-22T03:14:01.748929+0000","last_peered":"2024-09-22T03:14:01.748929+0000","last_clean":"2024-09-22T03:14:01.748929+0000","last_became_active":"2024-09-22T03:13:29.530274+0000","last_became_peered":"2024-09-22T03:13:29.530274+0000","last_unstale":"2024-09-22T03:14:01.748929+0000","last_undegraded":"2024-09-22T03:14:01.748929+0000","last_fullsized":"2024-09-22T03:14:01.748929+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"54'639","reported_seq":652,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:00.443568+0000","last_change":"2024-09-22T03:13:29.535751+0000","last_active":"2024-09-22T03:14:00.443568+0000","last_peered":"2024-09-22T03:14:00.443568+0000","last_clean":"2024-09-22T03:14:00.443568+0000","last_became_active":"2024-09-22T03:13:29.528896+0000","last_became_peered":"2024-09-22T03:13:29.528896+0000","last_unstale":"2024-09-22T03:14:00.443568+0000","last_undegraded":"2024-09-22T03:14:00.443568+0000","last_fullsized":"2024-09-22T03:14:00.443568+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"54'623","reported_seq":636,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:01.705609+0000","last_change":"2024-09-22T03:13:29.533410+0000","last_active":"2024-09-22T03:14:01.705609+0000","last_peered":"2024-09-22T03:14:01.705609+0000","last_clean":"2024-09-22T03:14:01.705609+0000","last_became_active":"2024-09-22T03:13:29.524152+0000","last_became_peered":"2024-09-22T03:13:29.524152+0000","last_unstale":"2024-09-22T03:14:01.705609+0000","last_undegraded":"2024-09-22T03:14:01.705609+0000","last_fullsized":"2024-09-22T03:14:01.705609+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"54'679","reported_seq":692,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:01.664774+0000","last_change":"2024-09-22T03:13:29.574097+0000","last_active":"2024-09-22T03:14:01.664774+0000","last_peered":"2024-09-22T03:14:01.664774+0000","last_clean":"2024-09-22T03:14:01.664774+0000","last_became_active":"2024-09-22T03:13:29.566300+0000","last_became_peered":"2024-09-22T03:13:29.566300+0000","last_unstale":"2024-09-22T03:14:01.664774+0000","last_undegraded":"2024-09-22T03:14:01.664774+0000","last_fullsized":"2024-09-22T03:14:01.664774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"54'631","reported_seq":644,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:00.699620+0000","last_change":"2024-09-22T03:13:29.560741+0000","last_active":"2024-09-22T03:14:00.699620+0000","last_peered":"2024-09-22T03:14:00.699620+0000","last_clean":"2024-09-22T03:14:00.699620+0000","last_became_active":"2024-09-22T03:13:29.557303+0000","last_became_peered":"2024-09-22T03:13:29.557303+0000","last_unstale":"2024-09-22T03:14:00.699620+0000","last_undegraded":"2024-09-22T03:14:00.699620+0000","last_fullsized":"2024-09-22T03:14:00.699620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"54'680","reported_seq":693,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:01.029727+0000","last_change":"2024-09-22T03:13:29.549832+0000","last_active":"2024-09-22T03:14:01.029727+0000","last_peered":"2024-09-22T03:14:01.029727+0000","last_clean":"2024-09-22T03:14:01.029727+0000","last_became_active":"2024-09-22T03:13:29.525112+0000","last_became_peered":"2024-09-22T03:13:29.525112+0000","last_unstale":"2024-09-22T03:14:01.029727+0000","last_undegraded":"2024-09-22T03:14:01.029727+0000","last_fullsized":"2024-09-22T03:14:01.029727+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5578752,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":5448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"54'567","reported_seq":580,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:00.656565+0000","last_change":"2024-09-22T03:13:29.556621+0000","last_active":"2024-09-22T03:14:00.656565+0000","last_peered":"2024-09-22T03:14:00.656565+0000","last_clean":"2024-09-22T03:14:00.656565+0000","last_became_active":"2024-09-22T03:13:29.551982+0000","last_became_peered":"2024-09-22T03:13:29.551982+0000","last_unstale":"2024-09-22T03:14:00.656565+0000","last_undegraded":"2024-09-22T03:14:00.656565+0000","last_fullsized":"2024-09-22T03:14:00.656565+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"54'615","reported_seq":628,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:01.246948+0000","last_change":"2024-09-22T03:13:29.548744+0000","last_active":"2024-09-22T03:14:01.246948+0000","last_peered":"2024-09-22T03:14:01.246948+0000","last_clean":"2024-09-22T03:14:01.246948+0000","last_became_active":"2024-09-22T03:13:29.542670+0000","last_became_peered":"2024-09-22T03:13:29.542670+0000","last_unstale":"2024-09-22T03:14:01.246948+0000","last_undegraded":"2024-09-22T03:14:01.246948+0000","last_fullsized":"2024-09-22T03:14:01.246948+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"54'551","reported_seq":564,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:00.565042+0000","last_change":"2024-09-22T03:13:29.547139+0000","last_active":"2024-09-22T03:14:00.565042+0000","last_peered":"2024-09-22T03:14:00.565042+0000","last_clean":"2024-09-22T03:14:00.565042+0000","last_became_active":"2024-09-22T03:13:29.541888+0000","last_became_peered":"2024-09-22T03:13:29.541888+0000","last_unstale":"2024-09-22T03:14:00.565042+0000","last_undegraded":"2024-09-22T03:14:00.565042+0000","last_fullsized":"2024-09-22T03:14:00.565042+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"54'575","reported_seq":588,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:58.464144+0000","last_change":"2024-09-22T03:13:29.587411+0000","last_active":"2024-09-22T03:13:58.464144+0000","last_peered":"2024-09-22T03:13:58.464144+0000","last_clean":"2024-09-22T03:13:58.464144+0000","last_became_active":"2024-09-22T03:13:29.583366+0000","last_became_peered":"2024-09-22T03:13:29.583366+0000","last_unstale":"2024-09-22T03:13:58.464144+0000","last_undegraded":"2024-09-22T03:13:58.464144+0000","last_fullsized":"2024-09-22T03:13:58.464144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'679","reported_seq":692,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:00.844461+0000","last_change":"2024-09-22T03:13:29.528163+0000","last_active":"2024-09-22T03:14:00.844461+0000","last_peered":"2024-09-22T03:14:00.844461+0000","last_clean":"2024-09-22T03:14:00.844461+0000","last_became_active":"2024-09-22T03:13:29.521737+0000","last_became_peered":"2024-09-22T03:13:29.521737+0000","last_unstale":"2024-09-22T03:14:00.844461+0000","last_undegraded":"2024-09-22T03:14:00.844461+0000","last_fullsized":"2024-09-22T03:14:00.844461+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"54'567","reported_seq":580,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:59.789339+0000","last_change":"2024-09-22T03:13:29.566804+0000","last_active":"2024-09-22T03:13:59.789339+0000","last_peered":"2024-09-22T03:13:59.789339+0000","last_clean":"2024-09-22T03:13:59.789339+0000","last_became_active":"2024-09-22T03:13:29.560558+0000","last_became_peered":"2024-09-22T03:13:29.560558+0000","last_unstale":"2024-09-22T03:13:59.789339+0000","last_undegraded":"2024-09-22T03:13:59.789339+0000","last_fullsized":"2024-09-22T03:13:59.789339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":80158720,"num_objects":1224,"num_object_clones":0,"num_object_copies":3672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9785,"num_write_kb":78280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":120438784,"data_stored":240877568,"data_compressed":12434562,"data_compressed_allocated":120438784,"data_compressed_original":240877568,"omap_allocated":0,"internal_metadata":0},"log_size":9769,"ondisk_log_size":9769,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99672,"kb_used_data":30344,"kb_used_omap":0,"kb_used_meta":69312,"kb_avail":94272168,"statfs":{"total":96636764160,"available":96534700032,"internally_reserved":0,"allocated":31072256,"data_stored":61370235,"data_compressed":3159471,"data_compressed_allocated":30601216,"data_compressed_original":61202432,"omap_allocated":0,"internal_metadata":70975488},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77176,"kb_used_data":22312,"kb_used_omap":0,"kb_used_meta":54848,"kb_avail":94294664,"statfs":{"total":96636764160,"available":96557735936,"internally_reserved":0,"allocated":22847488,"data_stored":45388187,"data_compressed":2333796,"data_compressed_allocated":22355968,"data_compressed_original":45203456,"omap_allocated":0,"internal_metadata":56164352},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98480,"kb_used_data":34336,"kb_used_omap":0,"kb_used_meta":64128,"kb_avail":94273360,"statfs":{"total":96636764160,"available":96535920640,"internally_reserved":0,"allocated":35160064,"data_stored":70013339,"data_compressed":3605004,"data_compressed_allocated":34668544,"data_compressed_original":69828608,"omap_allocated":0,"internal_metadata":65667072},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706248,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77076,"kb_used_data":31044,"kb_used_omap":0,"kb_used_meta":46016,"kb_avail":94294764,"statfs":{"total":96636764160,"available":96557838336,"internally_reserved":0,"allocated":31789056,"data_stored":63279496,"data_compressed":3257394,"data_compressed_allocated":31301632,"data_compressed_original":63094784,"omap_allocated":0,"internal_metadata":47120384},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31727616,"data_stored":63455232,"data_compressed":3275656,"data_compressed_allocated":31727616,"data_compressed_original":63455232,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":35196928,"data_stored":70393856,"data_compressed":3633841,"data_compressed_allocated":35196928,"data_compressed_original":70393856,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22577152,"data_stored":45154304,"data_compressed":2330908,"data_compressed_allocated":22577152,"data_compressed_original":45154304,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30937088,"data_stored":61874176,"data_compressed":3194157,"data_compressed_allocated":30937088,"data_compressed_original":61874176,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:14:04.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 34 16 10659 10643 2.44535 2.07812 0.0366497 0.0510462 2024-09-22T03:14:05.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 35 16 10962 10946 2.44311 2.36719 0.0576841 0.0511334 2024-09-22T03:14:05.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:06.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:06.095+0000 7f35d5397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:06.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:06.103+0000 7f35d5397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:06.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 36 16 11258 11242 2.43948 2.3125 0.0268617 0.0511864 2024-09-22T03:14:07.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 37 16 11536 11520 2.43224 2.17188 0.0472908 0.0513377 2024-09-22T03:14:08.219 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:08.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:08.341+0000 7f09a846c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:08.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:08.347+0000 7f09a846c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:08.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 38 16 11818 11802 2.42621 2.20312 0.0475065 0.0514583 2024-09-22T03:14:09.492 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:14:09.492 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:14:09.493 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:14:09.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:14:09.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 39 16 12120 12104 2.42449 2.35938 0.0349614 0.0514563 2024-09-22T03:14:09.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:09.616+0000 7f08f8357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:09.626+0000 7f08f8357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:09.675 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:09.675 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:09.676 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:09.676 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:09.676 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:09.676 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:09.676 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:09.676 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:09.676 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:09.676 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:09.676 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:09.676 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:09.679 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:09.680 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:09.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:14:09.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:09.872+0000 7fea1684f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:09.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:09.887+0000 7fea1684f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:09.957 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:09.957 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:09.957 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:09.957 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:09.959 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:09.960 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:09.960 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:14:10.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:10.087+0000 7fd222197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:10.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:10.101+0000 7fd222197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:10.130 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:10.130 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:10.130 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:10.130 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:10.130 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:10.131 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:10.131 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:10.131 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:10.131 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:10.131 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:10.131 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:10.131 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:10.135 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:10.135 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:10.135 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:14:10.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:10.276+0000 7f0ad5d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:10.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:10.286+0000 7f0ad5d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:10.305 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:10.305 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:10.305 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:10.307 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:10.307 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:10.504 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:10.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:14:10.532543+0000 min lat: 0.00843874 max lat: 0.175624 avg lat: 0.0516706 2024-09-22T03:14:10.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:14:10.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 40 16 12398 12382 2.41817 2.17188 0.0353494 0.0516706 2024-09-22T03:14:10.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:10.632+0000 7f5184797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:10.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:10.639+0000 7f5184797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:11.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 41 16 12673 12657 2.41158 2.14844 0.0630464 0.051768 2024-09-22T03:14:12.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 42 16 12954 12938 2.40643 2.19531 0.0351356 0.0518798 2024-09-22T03:14:12.840 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:12.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:12.963+0000 7f6a89197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:12.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:12.972+0000 7f6a89197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:13.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 43 16 13234 13218 2.40133 2.1875 0.0228414 0.0520167 2024-09-22T03:14:14.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 44 16 13545 13529 2.40198 2.42969 0.0619725 0.0520014 2024-09-22T03:14:15.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:15.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:15.239+0000 7f82ca0ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:15.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:15.244+0000 7f82ca0ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:15.308 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:14:15.308 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:14:15.309 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:14:15.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:15.442+0000 7f8b4f06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:15.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:15.452+0000 7f8b4f06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:15.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 45 16 13818 13802 2.39599 2.13281 0.0787992 0.0521208 2024-09-22T03:14:15.748 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:14:15.749 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:14:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-09-22T03:14:14.795693+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":104104499,"num_objects":1585,"num_object_clones":0,"num_object_copies":4755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":12775,"num_write_kb":102984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12720,"ondisk_log_size":12720,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":407648,"kb_used_data":152480,"kb_used_omap":0,"kb_used_meta":255104,"kb_avail":377079712,"statfs":{"total":386547056640,"available":386129625088,"internally_reserved":0,"allocated":156139520,"data_stored":310592569,"data_compressed":15998115,"data_compressed_allocated":154198016,"data_compressed_original":309870592,"omap_allocated":0,"internal_metadata":261226496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23355392,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2851,"num_write_kb":22808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001948"},"pg_stats":[{"pgid":"8.7","version":"54'765","reported_seq":778,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:11.749432+0000","last_change":"2024-09-22T03:13:29.529991+0000","last_active":"2024-09-22T03:14:11.749432+0000","last_peered":"2024-09-22T03:14:11.749432+0000","last_clean":"2024-09-22T03:14:11.749432+0000","last_became_active":"2024-09-22T03:13:29.525739+0000","last_became_peered":"2024-09-22T03:13:29.525739+0000","last_unstale":"2024-09-22T03:14:11.749432+0000","last_undegraded":"2024-09-22T03:14:11.749432+0000","last_fullsized":"2024-09-22T03:14:11.749432+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6275072,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":6128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"54'847","reported_seq":860,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:10.703119+0000","last_change":"2024-09-22T03:13:29.531031+0000","last_active":"2024-09-22T03:14:10.703119+0000","last_peered":"2024-09-22T03:14:10.703119+0000","last_clean":"2024-09-22T03:14:10.703119+0000","last_became_active":"2024-09-22T03:13:29.526121+0000","last_became_peered":"2024-09-22T03:13:29.526121+0000","last_unstale":"2024-09-22T03:14:10.703119+0000","last_undegraded":"2024-09-22T03:14:10.703119+0000","last_fullsized":"2024-09-22T03:14:10.703119+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"54'671","reported_seq":684,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:11.258379+0000","last_change":"2024-09-22T03:13:29.558419+0000","last_active":"2024-09-22T03:14:11.258379+0000","last_peered":"2024-09-22T03:14:11.258379+0000","last_clean":"2024-09-22T03:14:11.258379+0000","last_became_active":"2024-09-22T03:13:29.554453+0000","last_became_peered":"2024-09-22T03:13:29.554453+0000","last_unstale":"2024-09-22T03:14:11.258379+0000","last_undegraded":"2024-09-22T03:14:11.258379+0000","last_fullsized":"2024-09-22T03:14:11.258379+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'697","reported_seq":710,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:10.709419+0000","last_change":"2024-09-22T03:13:29.576486+0000","last_active":"2024-09-22T03:14:10.709419+0000","last_peered":"2024-09-22T03:14:10.709419+0000","last_clean":"2024-09-22T03:14:10.709419+0000","last_became_active":"2024-09-22T03:13:29.572229+0000","last_became_peered":"2024-09-22T03:13:29.572229+0000","last_unstale":"2024-09-22T03:14:10.709419+0000","last_undegraded":"2024-09-22T03:14:10.709419+0000","last_fullsized":"2024-09-22T03:14:10.709419+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5718016,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":5584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"54'783","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:11.640547+0000","last_change":"2024-09-22T03:13:29.555891+0000","last_active":"2024-09-22T03:14:11.640547+0000","last_peered":"2024-09-22T03:14:11.640547+0000","last_clean":"2024-09-22T03:14:11.640547+0000","last_became_active":"2024-09-22T03:13:29.530274+0000","last_became_peered":"2024-09-22T03:13:29.530274+0000","last_unstale":"2024-09-22T03:14:11.640547+0000","last_undegraded":"2024-09-22T03:14:11.640547+0000","last_fullsized":"2024-09-22T03:14:11.640547+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"54'823","reported_seq":836,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:10.651523+0000","last_change":"2024-09-22T03:13:29.535751+0000","last_active":"2024-09-22T03:14:10.651523+0000","last_peered":"2024-09-22T03:14:10.651523+0000","last_clean":"2024-09-22T03:14:10.651523+0000","last_became_active":"2024-09-22T03:13:29.528896+0000","last_became_peered":"2024-09-22T03:13:29.528896+0000","last_unstale":"2024-09-22T03:14:10.651523+0000","last_undegraded":"2024-09-22T03:14:10.651523+0000","last_fullsized":"2024-09-22T03:14:10.651523+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"54'791","reported_seq":804,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:10.982695+0000","last_change":"2024-09-22T03:13:29.533410+0000","last_active":"2024-09-22T03:14:10.982695+0000","last_peered":"2024-09-22T03:14:10.982695+0000","last_clean":"2024-09-22T03:14:10.982695+0000","last_became_active":"2024-09-22T03:13:29.524152+0000","last_became_peered":"2024-09-22T03:13:29.524152+0000","last_unstale":"2024-09-22T03:14:10.982695+0000","last_undegraded":"2024-09-22T03:14:10.982695+0000","last_fullsized":"2024-09-22T03:14:10.982695+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"54'883","reported_seq":896,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:11.762226+0000","last_change":"2024-09-22T03:13:29.574097+0000","last_active":"2024-09-22T03:14:11.762226+0000","last_peered":"2024-09-22T03:14:11.762226+0000","last_clean":"2024-09-22T03:14:11.762226+0000","last_became_active":"2024-09-22T03:13:29.566300+0000","last_became_peered":"2024-09-22T03:13:29.566300+0000","last_unstale":"2024-09-22T03:14:11.762226+0000","last_undegraded":"2024-09-22T03:14:11.762226+0000","last_fullsized":"2024-09-22T03:14:11.762226+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7241728,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":884,"num_write_kb":7072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"54'847","reported_seq":860,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:10.137703+0000","last_change":"2024-09-22T03:13:29.560741+0000","last_active":"2024-09-22T03:14:10.137703+0000","last_peered":"2024-09-22T03:14:10.137703+0000","last_clean":"2024-09-22T03:14:10.137703+0000","last_became_active":"2024-09-22T03:13:29.557303+0000","last_became_peered":"2024-09-22T03:13:29.557303+0000","last_unstale":"2024-09-22T03:14:10.137703+0000","last_undegraded":"2024-09-22T03:14:10.137703+0000","last_fullsized":"2024-09-22T03:14:10.137703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"54'879","reported_seq":892,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:10.441396+0000","last_change":"2024-09-22T03:13:29.549832+0000","last_active":"2024-09-22T03:14:10.441396+0000","last_peered":"2024-09-22T03:14:10.441396+0000","last_clean":"2024-09-22T03:14:10.441396+0000","last_became_active":"2024-09-22T03:13:29.525112+0000","last_became_peered":"2024-09-22T03:13:29.525112+0000","last_unstale":"2024-09-22T03:14:10.441396+0000","last_undegraded":"2024-09-22T03:14:10.441396+0000","last_fullsized":"2024-09-22T03:14:10.441396+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"54'711","reported_seq":724,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:10.342968+0000","last_change":"2024-09-22T03:13:29.556621+0000","last_active":"2024-09-22T03:14:10.342968+0000","last_peered":"2024-09-22T03:14:10.342968+0000","last_clean":"2024-09-22T03:14:10.342968+0000","last_became_active":"2024-09-22T03:13:29.551982+0000","last_became_peered":"2024-09-22T03:13:29.551982+0000","last_unstale":"2024-09-22T03:14:10.342968+0000","last_undegraded":"2024-09-22T03:14:10.342968+0000","last_fullsized":"2024-09-22T03:14:10.342968+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"54'791","reported_seq":804,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:11.690003+0000","last_change":"2024-09-22T03:13:29.548744+0000","last_active":"2024-09-22T03:14:11.690003+0000","last_peered":"2024-09-22T03:14:11.690003+0000","last_clean":"2024-09-22T03:14:11.690003+0000","last_became_active":"2024-09-22T03:13:29.542670+0000","last_became_peered":"2024-09-22T03:13:29.542670+0000","last_unstale":"2024-09-22T03:14:11.690003+0000","last_undegraded":"2024-09-22T03:14:11.690003+0000","last_fullsized":"2024-09-22T03:14:11.690003+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"54'719","reported_seq":732,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:09.706963+0000","last_change":"2024-09-22T03:13:29.547139+0000","last_active":"2024-09-22T03:14:09.706963+0000","last_peered":"2024-09-22T03:14:09.706963+0000","last_clean":"2024-09-22T03:14:09.706963+0000","last_became_active":"2024-09-22T03:13:29.541888+0000","last_became_peered":"2024-09-22T03:13:29.541888+0000","last_unstale":"2024-09-22T03:14:09.706963+0000","last_undegraded":"2024-09-22T03:14:09.706963+0000","last_fullsized":"2024-09-22T03:14:09.706963+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"54'719","reported_seq":732,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:10.223040+0000","last_change":"2024-09-22T03:13:29.587411+0000","last_active":"2024-09-22T03:14:10.223040+0000","last_peered":"2024-09-22T03:14:10.223040+0000","last_clean":"2024-09-22T03:14:10.223040+0000","last_became_active":"2024-09-22T03:13:29.583366+0000","last_became_peered":"2024-09-22T03:13:29.583366+0000","last_unstale":"2024-09-22T03:14:10.223040+0000","last_undegraded":"2024-09-22T03:14:10.223040+0000","last_fullsized":"2024-09-22T03:14:10.223040+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'919","reported_seq":932,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:11.517463+0000","last_change":"2024-09-22T03:13:29.528163+0000","last_active":"2024-09-22T03:14:11.517463+0000","last_peered":"2024-09-22T03:14:11.517463+0000","last_clean":"2024-09-22T03:14:11.517463+0000","last_became_active":"2024-09-22T03:13:29.521737+0000","last_became_peered":"2024-09-22T03:13:29.521737+0000","last_unstale":"2024-09-22T03:14:11.517463+0000","last_undegraded":"2024-09-22T03:14:11.517463+0000","last_fullsized":"2024-09-22T03:14:11.517463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"54'775","reported_seq":788,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:10.238694+0000","last_change":"2024-09-22T03:13:29.566804+0000","last_active":"2024-09-22T03:14:10.238694+0000","last_peered":"2024-09-22T03:14:10.238694+0000","last_clean":"2024-09-22T03:14:10.238694+0000","last_became_active":"2024-09-22T03:13:29.560558+0000","last_became_peered":"2024-09-22T03:13:29.560558+0000","last_unstale":"2024-09-22T03:14:10.238694+0000","last_undegraded":"2024-09-22T03:14:10.238694+0000","last_fullsized":"2024-09-22T03:14:10.238694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":103514112,"num_objects":1581,"num_object_clones":0,"num_object_copies":4743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12636,"num_write_kb":101088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155672576,"data_stored":311345152,"data_compressed":16073205,"data_compressed_allocated":155672576,"data_compressed_original":311345152,"omap_allocated":0,"internal_metadata":0},"log_size":12620,"ondisk_log_size":12620,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120896,"kb_used_data":39088,"kb_used_omap":0,"kb_used_meta":81792,"kb_avail":94250944,"statfs":{"total":96636764160,"available":96512966656,"internally_reserved":0,"allocated":40026112,"data_stored":79277947,"data_compressed":4084149,"data_compressed_allocated":39555072,"data_compressed_original":79110144,"omap_allocated":0,"internal_metadata":83755008},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75360,"kb_used_data":28816,"kb_used_omap":0,"kb_used_meta":46528,"kb_avail":94296480,"statfs":{"total":96636764160,"available":96559595520,"internally_reserved":0,"allocated":29507584,"data_stored":58708379,"data_compressed":3021593,"data_compressed_allocated":29016064,"data_compressed_original":58523648,"omap_allocated":0,"internal_metadata":47644672},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116644,"kb_used_data":44180,"kb_used_omap":0,"kb_used_meta":72448,"kb_avail":94255196,"statfs":{"total":96636764160,"available":96517320704,"internally_reserved":0,"allocated":45240320,"data_stored":90173851,"data_compressed":4646006,"data_compressed_allocated":44748800,"data_compressed_original":89989120,"omap_allocated":0,"internal_metadata":74186752},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94748,"kb_used_data":40396,"kb_used_omap":0,"kb_used_meta":54336,"kb_avail":94277092,"statfs":{"total":96636764160,"available":96539742208,"internally_reserved":0,"allocated":41365504,"data_stored":82432392,"data_compressed":4246367,"data_compressed_allocated":40878080,"data_compressed_original":82247680,"omap_allocated":0,"internal_metadata":55640064},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41275392,"data_stored":82550784,"data_compressed":4261668,"data_compressed_allocated":41275392,"data_compressed_original":82550784,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45211648,"data_stored":90423296,"data_compressed":4668075,"data_compressed_allocated":45211648,"data_compressed_original":90423296,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29229056,"data_stored":58458112,"data_compressed":3017859,"data_compressed_allocated":29229056,"data_compressed_original":58458112,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39956480,"data_stored":79912960,"data_compressed":4125603,"data_compressed_allocated":39956480,"data_compressed_original":79912960,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:14:16.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 46 16 14077 14061 2.38789 2.02344 0.0437284 0.0523087 2024-09-22T03:14:17.369 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:17.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:17.505+0000 7f4826f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:17.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:17.513+0000 7f4826f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:17.533 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 47 16 14348 14332 2.38213 2.11719 0.0395356 0.052428 2024-09-22T03:14:18.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 48 16 14605 14589 2.37432 2.00781 0.0670462 0.0525887 2024-09-22T03:14:19.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 49 16 14880 14864 2.36971 2.14844 0.065211 0.052689 2024-09-22T03:14:19.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:19.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:19.887+0000 7fc3f3357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:19.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:19.893+0000 7fc3f20f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:20.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 50 16 15129 15113 2.36122 1.94531 0.0311331 0.0528957 2024-09-22T03:14:20.771 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:14:20.772 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:14:20.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:14:20.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:20.898+0000 7f5fba397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:20.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:20.907+0000 7f5fba397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:21.143 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:14:21.143 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:14:21.158 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-09-22T03:14:20.796782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":120054323,"num_objects":1828,"num_object_clones":0,"num_object_copies":5484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":14722,"num_write_kb":118560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14667,"ondisk_log_size":14667,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":434312,"kb_used_data":173576,"kb_used_omap":0,"kb_used_meta":260672,"kb_avail":377053048,"statfs":{"total":386547056640,"available":386102321152,"internally_reserved":0,"allocated":177741824,"data_stored":353797177,"data_compressed":18229017,"data_compressed_allocated":175800320,"data_compressed_original":353075200,"omap_allocated":0,"internal_metadata":266928128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27787264,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3392,"num_write_kb":27136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002026"},"pg_stats":[{"pgid":"8.7","version":"54'863","reported_seq":876,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:15.456261+0000","last_change":"2024-09-22T03:13:29.529991+0000","last_active":"2024-09-22T03:14:15.456261+0000","last_peered":"2024-09-22T03:14:15.456261+0000","last_clean":"2024-09-22T03:14:15.456261+0000","last_became_active":"2024-09-22T03:13:29.525739+0000","last_became_peered":"2024-09-22T03:13:29.525739+0000","last_unstale":"2024-09-22T03:14:15.456261+0000","last_undegraded":"2024-09-22T03:14:15.456261+0000","last_fullsized":"2024-09-22T03:14:15.456261+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"54'911","reported_seq":924,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:16.505964+0000","last_change":"2024-09-22T03:13:29.531031+0000","last_active":"2024-09-22T03:14:16.505964+0000","last_peered":"2024-09-22T03:14:16.505964+0000","last_clean":"2024-09-22T03:14:16.505964+0000","last_became_active":"2024-09-22T03:13:29.526121+0000","last_became_peered":"2024-09-22T03:13:29.526121+0000","last_unstale":"2024-09-22T03:14:16.505964+0000","last_undegraded":"2024-09-22T03:14:16.505964+0000","last_fullsized":"2024-09-22T03:14:16.505964+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":911,"log_dups_size":0,"ondisk_log_size":911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"54'743","reported_seq":756,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:16.075715+0000","last_change":"2024-09-22T03:13:29.558419+0000","last_active":"2024-09-22T03:14:16.075715+0000","last_peered":"2024-09-22T03:14:16.075715+0000","last_clean":"2024-09-22T03:14:16.075715+0000","last_became_active":"2024-09-22T03:13:29.554453+0000","last_became_peered":"2024-09-22T03:13:29.554453+0000","last_unstale":"2024-09-22T03:14:16.075715+0000","last_undegraded":"2024-09-22T03:14:16.075715+0000","last_fullsized":"2024-09-22T03:14:16.075715+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'896","reported_seq":909,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:20.514606+0000","last_change":"2024-09-22T03:13:29.576486+0000","last_active":"2024-09-22T03:14:20.514606+0000","last_peered":"2024-09-22T03:14:20.514606+0000","last_clean":"2024-09-22T03:14:20.514606+0000","last_became_active":"2024-09-22T03:13:29.572229+0000","last_became_peered":"2024-09-22T03:13:29.572229+0000","last_unstale":"2024-09-22T03:14:20.514606+0000","last_undegraded":"2024-09-22T03:14:20.514606+0000","last_fullsized":"2024-09-22T03:14:20.514606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7348224,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":897,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"54'847","reported_seq":860,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:16.555843+0000","last_change":"2024-09-22T03:13:29.555891+0000","last_active":"2024-09-22T03:14:16.555843+0000","last_peered":"2024-09-22T03:14:16.555843+0000","last_clean":"2024-09-22T03:14:16.555843+0000","last_became_active":"2024-09-22T03:13:29.530274+0000","last_became_peered":"2024-09-22T03:13:29.530274+0000","last_unstale":"2024-09-22T03:14:16.555843+0000","last_undegraded":"2024-09-22T03:14:16.555843+0000","last_fullsized":"2024-09-22T03:14:16.555843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"54'935","reported_seq":948,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:19.280735+0000","last_change":"2024-09-22T03:13:29.535751+0000","last_active":"2024-09-22T03:14:19.280735+0000","last_peered":"2024-09-22T03:14:19.280735+0000","last_clean":"2024-09-22T03:14:19.280735+0000","last_became_active":"2024-09-22T03:13:29.528896+0000","last_became_peered":"2024-09-22T03:13:29.528896+0000","last_unstale":"2024-09-22T03:14:19.280735+0000","last_undegraded":"2024-09-22T03:14:19.280735+0000","last_fullsized":"2024-09-22T03:14:19.280735+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"54'871","reported_seq":884,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:16.621223+0000","last_change":"2024-09-22T03:13:29.533410+0000","last_active":"2024-09-22T03:14:16.621223+0000","last_peered":"2024-09-22T03:14:16.621223+0000","last_clean":"2024-09-22T03:14:16.621223+0000","last_became_active":"2024-09-22T03:13:29.524152+0000","last_became_peered":"2024-09-22T03:13:29.524152+0000","last_unstale":"2024-09-22T03:14:16.621223+0000","last_undegraded":"2024-09-22T03:14:16.621223+0000","last_fullsized":"2024-09-22T03:14:16.621223+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"54'975","reported_seq":988,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:15.773710+0000","last_change":"2024-09-22T03:13:29.574097+0000","last_active":"2024-09-22T03:14:15.773710+0000","last_peered":"2024-09-22T03:14:15.773710+0000","last_clean":"2024-09-22T03:14:15.773710+0000","last_became_active":"2024-09-22T03:13:29.566300+0000","last_became_peered":"2024-09-22T03:13:29.566300+0000","last_unstale":"2024-09-22T03:14:15.773710+0000","last_undegraded":"2024-09-22T03:14:15.773710+0000","last_fullsized":"2024-09-22T03:14:15.773710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"54'967","reported_seq":980,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:20.692298+0000","last_change":"2024-09-22T03:13:29.560741+0000","last_active":"2024-09-22T03:14:20.692298+0000","last_peered":"2024-09-22T03:14:20.692298+0000","last_clean":"2024-09-22T03:14:20.692298+0000","last_became_active":"2024-09-22T03:13:29.557303+0000","last_became_peered":"2024-09-22T03:13:29.557303+0000","last_unstale":"2024-09-22T03:14:20.692298+0000","last_undegraded":"2024-09-22T03:14:20.692298+0000","last_fullsized":"2024-09-22T03:14:20.692298+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"54'943","reported_seq":956,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:16.710118+0000","last_change":"2024-09-22T03:13:29.549832+0000","last_active":"2024-09-22T03:14:16.710118+0000","last_peered":"2024-09-22T03:14:16.710118+0000","last_clean":"2024-09-22T03:14:16.710118+0000","last_became_active":"2024-09-22T03:13:29.525112+0000","last_became_peered":"2024-09-22T03:13:29.525112+0000","last_unstale":"2024-09-22T03:14:16.710118+0000","last_undegraded":"2024-09-22T03:14:16.710118+0000","last_fullsized":"2024-09-22T03:14:16.710118+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"54'943","reported_seq":956,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:20.295612+0000","last_change":"2024-09-22T03:13:29.556621+0000","last_active":"2024-09-22T03:14:20.295612+0000","last_peered":"2024-09-22T03:14:20.295612+0000","last_clean":"2024-09-22T03:14:20.295612+0000","last_became_active":"2024-09-22T03:13:29.551982+0000","last_became_peered":"2024-09-22T03:13:29.551982+0000","last_unstale":"2024-09-22T03:14:20.295612+0000","last_undegraded":"2024-09-22T03:14:20.295612+0000","last_fullsized":"2024-09-22T03:14:20.295612+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"54'911","reported_seq":924,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:16.555827+0000","last_change":"2024-09-22T03:13:29.548744+0000","last_active":"2024-09-22T03:14:16.555827+0000","last_peered":"2024-09-22T03:14:16.555827+0000","last_clean":"2024-09-22T03:14:16.555827+0000","last_became_active":"2024-09-22T03:13:29.542670+0000","last_became_peered":"2024-09-22T03:13:29.542670+0000","last_unstale":"2024-09-22T03:14:16.555827+0000","last_undegraded":"2024-09-22T03:14:16.555827+0000","last_fullsized":"2024-09-22T03:14:16.555827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":911,"log_dups_size":0,"ondisk_log_size":911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"54'887","reported_seq":900,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:20.632528+0000","last_change":"2024-09-22T03:13:29.547139+0000","last_active":"2024-09-22T03:14:20.632528+0000","last_peered":"2024-09-22T03:14:20.632528+0000","last_clean":"2024-09-22T03:14:20.632528+0000","last_became_active":"2024-09-22T03:13:29.541888+0000","last_became_peered":"2024-09-22T03:13:29.541888+0000","last_unstale":"2024-09-22T03:14:20.632528+0000","last_undegraded":"2024-09-22T03:14:20.632528+0000","last_fullsized":"2024-09-22T03:14:20.632528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"54'895","reported_seq":908,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:19.480620+0000","last_change":"2024-09-22T03:13:29.587411+0000","last_active":"2024-09-22T03:14:19.480620+0000","last_peered":"2024-09-22T03:14:19.480620+0000","last_clean":"2024-09-22T03:14:19.480620+0000","last_became_active":"2024-09-22T03:13:29.583366+0000","last_became_peered":"2024-09-22T03:13:29.583366+0000","last_unstale":"2024-09-22T03:14:19.480620+0000","last_undegraded":"2024-09-22T03:14:19.480620+0000","last_fullsized":"2024-09-22T03:14:19.480620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'1045","reported_seq":1058,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:16.764365+0000","last_change":"2024-09-22T03:13:29.528163+0000","last_active":"2024-09-22T03:14:16.764365+0000","last_peered":"2024-09-22T03:14:16.764365+0000","last_clean":"2024-09-22T03:14:16.764365+0000","last_became_active":"2024-09-22T03:13:29.521737+0000","last_became_peered":"2024-09-22T03:13:29.521737+0000","last_unstale":"2024-09-22T03:14:16.764365+0000","last_undegraded":"2024-09-22T03:14:16.764365+0000","last_fullsized":"2024-09-22T03:14:16.764365+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1045,"log_dups_size":0,"ondisk_log_size":1045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8568832,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1046,"num_write_kb":8368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"54'935","reported_seq":948,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:20.739322+0000","last_change":"2024-09-22T03:13:29.566804+0000","last_active":"2024-09-22T03:14:20.739322+0000","last_peered":"2024-09-22T03:14:20.739322+0000","last_clean":"2024-09-22T03:14:20.739322+0000","last_became_active":"2024-09-22T03:13:29.560558+0000","last_became_peered":"2024-09-22T03:13:29.560558+0000","last_unstale":"2024-09-22T03:14:20.739322+0000","last_undegraded":"2024-09-22T03:14:20.739322+0000","last_fullsized":"2024-09-22T03:14:20.739322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":119463936,"num_objects":1824,"num_object_clones":0,"num_object_copies":5472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14583,"num_write_kb":116664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177049600,"data_stored":354099200,"data_compressed":18280842,"data_compressed_allocated":177049600,"data_compressed_original":354099200,"omap_allocated":0,"internal_metadata":0},"log_size":14567,"ondisk_log_size":14567,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112612,"kb_used_data":43284,"kb_used_omap":0,"kb_used_meta":69312,"kb_avail":94259228,"statfs":{"total":96636764160,"available":96521449472,"internally_reserved":0,"allocated":44322816,"data_stored":87871355,"data_compressed":4527876,"data_compressed_allocated":43851776,"data_compressed_original":87703552,"omap_allocated":0,"internal_metadata":70975488},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":82888,"kb_used_data":32184,"kb_used_omap":0,"kb_used_meta":50688,"kb_avail":94288952,"statfs":{"total":96636764160,"available":96551886848,"internally_reserved":0,"allocated":32956416,"data_stored":65606043,"data_compressed":3377759,"data_compressed_allocated":32464896,"data_compressed_original":65421312,"omap_allocated":0,"internal_metadata":51904512},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125948,"kb_used_data":49324,"kb_used_omap":0,"kb_used_meta":76608,"kb_avail":94245892,"statfs":{"total":96636764160,"available":96507793408,"internally_reserved":0,"allocated":50507776,"data_stored":100708763,"data_compressed":5189984,"data_compressed_allocated":50016256,"data_compressed_original":100524032,"omap_allocated":0,"internal_metadata":78446592},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706268,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112864,"kb_used_data":48784,"kb_used_omap":0,"kb_used_meta":64064,"kb_avail":94258976,"statfs":{"total":96636764160,"available":96521191424,"internally_reserved":0,"allocated":49954816,"data_stored":99611016,"data_compressed":5133398,"data_compressed_allocated":49467392,"data_compressed_original":99426304,"omap_allocated":0,"internal_metadata":65601536},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49762304,"data_stored":99524608,"data_compressed":5138124,"data_compressed_allocated":49762304,"data_compressed_original":99524608,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50429952,"data_stored":100859904,"data_compressed":5206977,"data_compressed_allocated":50429952,"data_compressed_original":100859904,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32645120,"data_stored":65290240,"data_compressed":3370641,"data_compressed_allocated":32645120,"data_compressed_original":65290240,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44212224,"data_stored":88424448,"data_compressed":4565100,"data_compressed_allocated":44212224,"data_compressed_original":88424448,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:14:21.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 51 16 15388 15372 2.35459 2.02344 0.0373916 0.053053 2024-09-22T03:14:22.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:22.184+0000 7fbf760d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:22.193+0000 7fbf760d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:22.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 52 16 15636 15620 2.34657 1.9375 0.0247185 0.0532355 2024-09-22T03:14:23.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 53 16 15882 15866 2.33855 1.92188 0.0364875 0.0534114 2024-09-22T03:14:24.391 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:24.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 54 16 16157 16141 2.33503 2.14844 0.0659952 0.0534891 2024-09-22T03:14:24.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:24.533+0000 7f85a54b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:24.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:24.540+0000 7f85a54b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:25.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 55 16 16396 16380 2.32652 1.86719 0.156012 0.0536129 2024-09-22T03:14:26.161 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:14:26.161 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:14:26.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:14:26.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:26.295+0000 7f0d950fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:26.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:26.305+0000 7f0d950fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:26.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 56 16 16631 16615 2.31776 1.83594 0.0591182 0.0538856 2024-09-22T03:14:26.608 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:14:26.609 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:14:26.629 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2024-09-22T03:14:24.797512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":126124595,"num_objects":1921,"num_object_clones":0,"num_object_copies":5763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":15463,"num_write_kb":124488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15408,"ondisk_log_size":15408,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":441680,"kb_used_data":185100,"kb_used_omap":0,"kb_used_meta":256512,"kb_avail":377045680,"statfs":{"total":386547056640,"available":386094776320,"internally_reserved":0,"allocated":189542400,"data_stored":377398329,"data_compressed":19447680,"data_compressed_allocated":187600896,"data_compressed_original":376676352,"omap_allocated":0,"internal_metadata":262668288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2688,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002124"},"pg_stats":[{"pgid":"8.7","version":"54'951","reported_seq":964,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:21.420956+0000","last_change":"2024-09-22T03:13:29.529991+0000","last_active":"2024-09-22T03:14:21.420956+0000","last_peered":"2024-09-22T03:14:21.420956+0000","last_clean":"2024-09-22T03:14:21.420956+0000","last_became_active":"2024-09-22T03:13:29.525739+0000","last_became_peered":"2024-09-22T03:13:29.525739+0000","last_unstale":"2024-09-22T03:14:21.420956+0000","last_undegraded":"2024-09-22T03:14:21.420956+0000","last_fullsized":"2024-09-22T03:14:21.420956+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":951,"log_dups_size":0,"ondisk_log_size":951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"54'1039","reported_seq":1052,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:21.361393+0000","last_change":"2024-09-22T03:13:29.531031+0000","last_active":"2024-09-22T03:14:21.361393+0000","last_peered":"2024-09-22T03:14:21.361393+0000","last_clean":"2024-09-22T03:14:21.361393+0000","last_became_active":"2024-09-22T03:13:29.526121+0000","last_became_peered":"2024-09-22T03:13:29.526121+0000","last_unstale":"2024-09-22T03:14:21.361393+0000","last_undegraded":"2024-09-22T03:14:21.361393+0000","last_fullsized":"2024-09-22T03:14:21.361393+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"54'799","reported_seq":812,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:21.157208+0000","last_change":"2024-09-22T03:13:29.558419+0000","last_active":"2024-09-22T03:14:21.157208+0000","last_peered":"2024-09-22T03:14:21.157208+0000","last_clean":"2024-09-22T03:14:21.157208+0000","last_became_active":"2024-09-22T03:13:29.554453+0000","last_became_peered":"2024-09-22T03:13:29.554453+0000","last_unstale":"2024-09-22T03:14:21.157208+0000","last_undegraded":"2024-09-22T03:14:21.157208+0000","last_fullsized":"2024-09-22T03:14:21.157208+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'896","reported_seq":909,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:20.514606+0000","last_change":"2024-09-22T03:13:29.576486+0000","last_active":"2024-09-22T03:14:20.514606+0000","last_peered":"2024-09-22T03:14:20.514606+0000","last_clean":"2024-09-22T03:14:20.514606+0000","last_became_active":"2024-09-22T03:13:29.572229+0000","last_became_peered":"2024-09-22T03:13:29.572229+0000","last_unstale":"2024-09-22T03:14:20.514606+0000","last_undegraded":"2024-09-22T03:14:20.514606+0000","last_fullsized":"2024-09-22T03:14:20.514606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7348224,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":897,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"54'887","reported_seq":900,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:21.480596+0000","last_change":"2024-09-22T03:13:29.555891+0000","last_active":"2024-09-22T03:14:21.480596+0000","last_peered":"2024-09-22T03:14:21.480596+0000","last_clean":"2024-09-22T03:14:21.480596+0000","last_became_active":"2024-09-22T03:13:29.530274+0000","last_became_peered":"2024-09-22T03:13:29.530274+0000","last_unstale":"2024-09-22T03:14:21.480596+0000","last_undegraded":"2024-09-22T03:14:21.480596+0000","last_fullsized":"2024-09-22T03:14:21.480596+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"54'935","reported_seq":948,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:19.280735+0000","last_change":"2024-09-22T03:13:29.535751+0000","last_active":"2024-09-22T03:14:19.280735+0000","last_peered":"2024-09-22T03:14:19.280735+0000","last_clean":"2024-09-22T03:14:19.280735+0000","last_became_active":"2024-09-22T03:13:29.528896+0000","last_became_peered":"2024-09-22T03:13:29.528896+0000","last_unstale":"2024-09-22T03:14:19.280735+0000","last_undegraded":"2024-09-22T03:14:19.280735+0000","last_fullsized":"2024-09-22T03:14:19.280735+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"54'931","reported_seq":944,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:21.764414+0000","last_change":"2024-09-22T03:13:29.533410+0000","last_active":"2024-09-22T03:14:21.764414+0000","last_peered":"2024-09-22T03:14:21.764414+0000","last_clean":"2024-09-22T03:14:21.764414+0000","last_became_active":"2024-09-22T03:13:29.524152+0000","last_became_peered":"2024-09-22T03:13:29.524152+0000","last_unstale":"2024-09-22T03:14:21.764414+0000","last_undegraded":"2024-09-22T03:14:21.764414+0000","last_fullsized":"2024-09-22T03:14:21.764414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7634944,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":932,"num_write_kb":7456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"54'1078","reported_seq":1091,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:21.765364+0000","last_change":"2024-09-22T03:13:29.574097+0000","last_active":"2024-09-22T03:14:21.765364+0000","last_peered":"2024-09-22T03:14:21.765364+0000","last_clean":"2024-09-22T03:14:21.765364+0000","last_became_active":"2024-09-22T03:13:29.566300+0000","last_became_peered":"2024-09-22T03:13:29.566300+0000","last_unstale":"2024-09-22T03:14:21.765364+0000","last_undegraded":"2024-09-22T03:14:21.765364+0000","last_fullsized":"2024-09-22T03:14:21.765364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1078,"log_dups_size":0,"ondisk_log_size":1078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8839168,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":8632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"54'967","reported_seq":980,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:20.692298+0000","last_change":"2024-09-22T03:13:29.560741+0000","last_active":"2024-09-22T03:14:20.692298+0000","last_peered":"2024-09-22T03:14:20.692298+0000","last_clean":"2024-09-22T03:14:20.692298+0000","last_became_active":"2024-09-22T03:13:29.557303+0000","last_became_peered":"2024-09-22T03:13:29.557303+0000","last_unstale":"2024-09-22T03:14:20.692298+0000","last_undegraded":"2024-09-22T03:14:20.692298+0000","last_fullsized":"2024-09-22T03:14:20.692298+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"54'1039","reported_seq":1052,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:21.610373+0000","last_change":"2024-09-22T03:13:29.549832+0000","last_active":"2024-09-22T03:14:21.610373+0000","last_peered":"2024-09-22T03:14:21.610373+0000","last_clean":"2024-09-22T03:14:21.610373+0000","last_became_active":"2024-09-22T03:13:29.525112+0000","last_became_peered":"2024-09-22T03:13:29.525112+0000","last_unstale":"2024-09-22T03:14:21.610373+0000","last_undegraded":"2024-09-22T03:14:21.610373+0000","last_fullsized":"2024-09-22T03:14:21.610373+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"54'943","reported_seq":956,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:20.295612+0000","last_change":"2024-09-22T03:13:29.556621+0000","last_active":"2024-09-22T03:14:20.295612+0000","last_peered":"2024-09-22T03:14:20.295612+0000","last_clean":"2024-09-22T03:14:20.295612+0000","last_became_active":"2024-09-22T03:13:29.551982+0000","last_became_peered":"2024-09-22T03:13:29.551982+0000","last_unstale":"2024-09-22T03:14:20.295612+0000","last_undegraded":"2024-09-22T03:14:20.295612+0000","last_fullsized":"2024-09-22T03:14:20.295612+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"54'991","reported_seq":1004,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:21.632203+0000","last_change":"2024-09-22T03:13:29.548744+0000","last_active":"2024-09-22T03:14:21.632203+0000","last_peered":"2024-09-22T03:14:21.632203+0000","last_clean":"2024-09-22T03:14:21.632203+0000","last_became_active":"2024-09-22T03:13:29.542670+0000","last_became_peered":"2024-09-22T03:13:29.542670+0000","last_unstale":"2024-09-22T03:14:21.632203+0000","last_undegraded":"2024-09-22T03:14:21.632203+0000","last_fullsized":"2024-09-22T03:14:21.632203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"54'887","reported_seq":900,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:20.632528+0000","last_change":"2024-09-22T03:13:29.547139+0000","last_active":"2024-09-22T03:14:20.632528+0000","last_peered":"2024-09-22T03:14:20.632528+0000","last_clean":"2024-09-22T03:14:20.632528+0000","last_became_active":"2024-09-22T03:13:29.541888+0000","last_became_peered":"2024-09-22T03:13:29.541888+0000","last_unstale":"2024-09-22T03:14:20.632528+0000","last_undegraded":"2024-09-22T03:14:20.632528+0000","last_fullsized":"2024-09-22T03:14:20.632528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"54'895","reported_seq":908,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:19.480620+0000","last_change":"2024-09-22T03:13:29.587411+0000","last_active":"2024-09-22T03:14:19.480620+0000","last_peered":"2024-09-22T03:14:19.480620+0000","last_clean":"2024-09-22T03:14:19.480620+0000","last_became_active":"2024-09-22T03:13:29.583366+0000","last_became_peered":"2024-09-22T03:13:29.583366+0000","last_unstale":"2024-09-22T03:14:19.480620+0000","last_undegraded":"2024-09-22T03:14:19.480620+0000","last_fullsized":"2024-09-22T03:14:19.480620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'1135","reported_seq":1148,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:21.254095+0000","last_change":"2024-09-22T03:13:29.528163+0000","last_active":"2024-09-22T03:14:21.254095+0000","last_peered":"2024-09-22T03:14:21.254095+0000","last_clean":"2024-09-22T03:14:21.254095+0000","last_became_active":"2024-09-22T03:13:29.521737+0000","last_became_peered":"2024-09-22T03:13:29.521737+0000","last_unstale":"2024-09-22T03:14:21.254095+0000","last_undegraded":"2024-09-22T03:14:21.254095+0000","last_fullsized":"2024-09-22T03:14:21.254095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1135,"log_dups_size":0,"ondisk_log_size":1135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"54'935","reported_seq":948,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:20.739322+0000","last_change":"2024-09-22T03:13:29.566804+0000","last_active":"2024-09-22T03:14:20.739322+0000","last_peered":"2024-09-22T03:14:20.739322+0000","last_clean":"2024-09-22T03:14:20.739322+0000","last_became_active":"2024-09-22T03:13:29.560558+0000","last_became_peered":"2024-09-22T03:13:29.560558+0000","last_unstale":"2024-09-22T03:14:20.739322+0000","last_undegraded":"2024-09-22T03:14:20.739322+0000","last_fullsized":"2024-09-22T03:14:20.739322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":125534208,"num_objects":1917,"num_object_clones":0,"num_object_copies":5751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15324,"num_write_kb":122592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":188870656,"data_stored":377741312,"data_compressed":19501620,"data_compressed_allocated":188870656,"data_compressed_original":377741312,"omap_allocated":0,"internal_metadata":0},"log_size":15308,"ondisk_log_size":15308,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673564,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116288,"kb_used_data":46960,"kb_used_omap":0,"kb_used_meta":69312,"kb_avail":94255552,"statfs":{"total":96636764160,"available":96517685248,"internally_reserved":0,"allocated":48087040,"data_stored":95399803,"data_compressed":4916613,"data_compressed_allocated":47616000,"data_compressed_original":95232000,"omap_allocated":0,"internal_metadata":70975488},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673564,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":90036,"kb_used_data":35172,"kb_used_omap":0,"kb_used_meta":54848,"kb_avail":94281804,"statfs":{"total":96636764160,"available":96544567296,"internally_reserved":0,"allocated":36016128,"data_stored":71725467,"data_compressed":3693740,"data_compressed_allocated":35524608,"data_compressed_original":71540736,"omap_allocated":0,"internal_metadata":56164352},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673564,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122492,"kb_used_data":54184,"kb_used_omap":0,"kb_used_meta":68288,"kb_avail":94249348,"statfs":{"total":96636764160,"available":96511332352,"internally_reserved":0,"allocated":55484416,"data_stored":110662043,"data_compressed":5703929,"data_compressed_allocated":54992896,"data_compressed_original":110477312,"omap_allocated":0,"internal_metadata":69926912},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706268,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112864,"kb_used_data":48784,"kb_used_omap":0,"kb_used_meta":64064,"kb_avail":94258976,"statfs":{"total":96636764160,"available":96521191424,"internally_reserved":0,"allocated":49954816,"data_stored":99611016,"data_compressed":5133398,"data_compressed_allocated":49467392,"data_compressed_original":99426304,"omap_allocated":0,"internal_metadata":65601536},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49762304,"data_stored":99524608,"data_compressed":5138124,"data_compressed_allocated":49762304,"data_compressed_original":99524608,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55369728,"data_stored":110739456,"data_compressed":5717115,"data_compressed_allocated":55369728,"data_compressed_original":110739456,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35749888,"data_stored":71499776,"data_compressed":3691275,"data_compressed_allocated":35749888,"data_compressed_original":71499776,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":47988736,"data_stored":95977472,"data_compressed":4955106,"data_compressed_allocated":47988736,"data_compressed_original":95977472,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:14:26.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:26.895+0000 7f60c08ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:26.901+0000 7f60c08ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:27.534 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 57 16 16874 16858 2.3104 1.89844 0.0379387 0.05405 2024-09-22T03:14:28.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 58 16 17158 17142 2.30881 2.21875 0.0236294 0.0540912 2024-09-22T03:14:29.050 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:29.185+0000 7f5867117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:29.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:29.190+0000 7f5867117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:29.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 59 16 17407 17391 2.30265 1.94531 0.0434859 0.054254 2024-09-22T03:14:30.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:14:30.534212+0000 min lat: 0.00843874 max lat: 0.208346 avg lat: 0.0543039 2024-09-22T03:14:30.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:14:30.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 60 16 17679 17663 2.29969 2.125 0.0687405 0.0543039 2024-09-22T03:14:31.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:31.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:31.462+0000 7f27caaa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:31.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:31.470+0000 7f27caaa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:31.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 61 16 17935 17919 2.29477 2 0.0492623 0.0544361 2024-09-22T03:14:31.631 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:14:31.631 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:14:31.631 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:14:31.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:14:31.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:31.765+0000 7fe671658640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:31.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:31.778+0000 7fe671658640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:31.817 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:31.817 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:31.817 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:14:31.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:31.952+0000 7f8b536d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:31.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:31.962+0000 7f8b536d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:31.983 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:31.987 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:31.987 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:31.987 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:14:32.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:32.106+0000 7f9b4bf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:32.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:32.115+0000 7f9b4bf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:32.142 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:32.142 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:32.142 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:32.142 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:32.142 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:32.142 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:32.142 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:32.142 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:32.142 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:32.142 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:32.144 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:32.144 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:32.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:14:32.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:32.259+0000 7f51e0157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:32.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:32.269+0000 7f51e0157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:32.294 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:32.294 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:32.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 62 16 18158 18142 2.28585 1.74219 0.0422757 0.0546445 2024-09-22T03:14:33.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 63 16 18416 18400 2.28156 2.01562 0.0480711 0.0547583 2024-09-22T03:14:33.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:33.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:33.687+0000 7f6faa90e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:33.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:33.693+0000 7f6faa90e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:34.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 64 16 18634 18618 2.27252 1.70312 0.0698105 0.0549733 2024-09-22T03:14:35.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 65 16 18881 18865 2.26725 1.92969 0.113348 0.055085 2024-09-22T03:14:35.918 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:36.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:36.054+0000 7fad2bb0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:36.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:36.061+0000 7fad2bb0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:36.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 66 16 19122 19106 2.26142 1.88281 0.0278634 0.055242 2024-09-22T03:14:37.295 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:14:37.296 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:14:37.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:14:37.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:37.431+0000 7fcaf4957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:37.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:37.441+0000 7fcaf4957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:37.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 67 16 19369 19353 2.25647 1.92969 0.0838323 0.0553613 2024-09-22T03:14:37.683 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:14:37.683 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:14:37.698 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-09-22T03:14:36.799662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":156738099,"num_objects":2387,"num_object_clones":0,"num_object_copies":7161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":19200,"num_write_kb":154384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19145,"ondisk_log_size":19145,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":498964,"kb_used_data":229908,"kb_used_omap":0,"kb_used_meta":268992,"kb_avail":376988396,"statfs":{"total":386547056640,"available":386036117504,"internally_reserved":0,"allocated":235425792,"data_stored":469165113,"data_compressed":24186126,"data_compressed_allocated":233484288,"data_compressed_original":468443136,"omap_allocated":0,"internal_metadata":275447808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":30613504,"num_objects":466,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3737,"num_write_kb":29896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002150"},"pg_stats":[{"pgid":"8.7","version":"54'1159","reported_seq":1172,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:35.794799+0000","last_change":"2024-09-22T03:13:29.529991+0000","last_active":"2024-09-22T03:14:35.794799+0000","last_peered":"2024-09-22T03:14:35.794799+0000","last_clean":"2024-09-22T03:14:35.794799+0000","last_became_active":"2024-09-22T03:13:29.525739+0000","last_became_peered":"2024-09-22T03:13:29.525739+0000","last_unstale":"2024-09-22T03:14:35.794799+0000","last_undegraded":"2024-09-22T03:14:35.794799+0000","last_fullsized":"2024-09-22T03:14:35.794799+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":9280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"54'1327","reported_seq":1340,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:36.527827+0000","last_change":"2024-09-22T03:13:29.531031+0000","last_active":"2024-09-22T03:14:36.527827+0000","last_peered":"2024-09-22T03:14:36.527827+0000","last_clean":"2024-09-22T03:14:36.527827+0000","last_became_active":"2024-09-22T03:13:29.526121+0000","last_became_peered":"2024-09-22T03:13:29.526121+0000","last_unstale":"2024-09-22T03:14:36.527827+0000","last_undegraded":"2024-09-22T03:14:36.527827+0000","last_fullsized":"2024-09-22T03:14:36.527827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"54'975","reported_seq":988,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:36.696485+0000","last_change":"2024-09-22T03:13:29.558419+0000","last_active":"2024-09-22T03:14:36.696485+0000","last_peered":"2024-09-22T03:14:36.696485+0000","last_clean":"2024-09-22T03:14:36.696485+0000","last_became_active":"2024-09-22T03:13:29.554453+0000","last_became_peered":"2024-09-22T03:13:29.554453+0000","last_unstale":"2024-09-22T03:14:36.696485+0000","last_undegraded":"2024-09-22T03:14:36.696485+0000","last_fullsized":"2024-09-22T03:14:36.696485+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'1228","reported_seq":1241,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:35.770449+0000","last_change":"2024-09-22T03:13:29.576486+0000","last_active":"2024-09-22T03:14:35.770449+0000","last_peered":"2024-09-22T03:14:35.770449+0000","last_clean":"2024-09-22T03:14:35.770449+0000","last_became_active":"2024-09-22T03:13:29.572229+0000","last_became_peered":"2024-09-22T03:13:29.572229+0000","last_unstale":"2024-09-22T03:14:35.770449+0000","last_undegraded":"2024-09-22T03:14:35.770449+0000","last_fullsized":"2024-09-22T03:14:35.770449+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1228,"log_dups_size":0,"ondisk_log_size":1228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10067968,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":9832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"54'1095","reported_seq":1108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:36.624011+0000","last_change":"2024-09-22T03:13:29.555891+0000","last_active":"2024-09-22T03:14:36.624011+0000","last_peered":"2024-09-22T03:14:36.624011+0000","last_clean":"2024-09-22T03:14:36.624011+0000","last_became_active":"2024-09-22T03:13:29.530274+0000","last_became_peered":"2024-09-22T03:13:29.530274+0000","last_unstale":"2024-09-22T03:14:36.624011+0000","last_undegraded":"2024-09-22T03:14:36.624011+0000","last_fullsized":"2024-09-22T03:14:36.624011+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1096,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"54'1119","reported_seq":1132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:35.498388+0000","last_change":"2024-09-22T03:13:29.535751+0000","last_active":"2024-09-22T03:14:35.498388+0000","last_peered":"2024-09-22T03:14:35.498388+0000","last_clean":"2024-09-22T03:14:35.498388+0000","last_became_active":"2024-09-22T03:13:29.528896+0000","last_became_peered":"2024-09-22T03:13:29.528896+0000","last_unstale":"2024-09-22T03:14:35.498388+0000","last_undegraded":"2024-09-22T03:14:35.498388+0000","last_fullsized":"2024-09-22T03:14:35.498388+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"54'1135","reported_seq":1148,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:36.452450+0000","last_change":"2024-09-22T03:13:29.533410+0000","last_active":"2024-09-22T03:14:36.452450+0000","last_peered":"2024-09-22T03:14:36.452450+0000","last_clean":"2024-09-22T03:14:36.452450+0000","last_became_active":"2024-09-22T03:13:29.524152+0000","last_became_peered":"2024-09-22T03:13:29.524152+0000","last_unstale":"2024-09-22T03:14:36.452450+0000","last_undegraded":"2024-09-22T03:14:36.452450+0000","last_fullsized":"2024-09-22T03:14:36.452450+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1135,"log_dups_size":0,"ondisk_log_size":1135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"54'1287","reported_seq":1300,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:36.347342+0000","last_change":"2024-09-22T03:13:29.574097+0000","last_active":"2024-09-22T03:14:36.347342+0000","last_peered":"2024-09-22T03:14:36.347342+0000","last_clean":"2024-09-22T03:14:36.347342+0000","last_became_active":"2024-09-22T03:13:29.566300+0000","last_became_peered":"2024-09-22T03:13:29.566300+0000","last_unstale":"2024-09-22T03:14:36.347342+0000","last_undegraded":"2024-09-22T03:14:36.347342+0000","last_fullsized":"2024-09-22T03:14:36.347342+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1287,"log_dups_size":0,"ondisk_log_size":1287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"54'1199","reported_seq":1212,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:34.802118+0000","last_change":"2024-09-22T03:13:29.560741+0000","last_active":"2024-09-22T03:14:34.802118+0000","last_peered":"2024-09-22T03:14:34.802118+0000","last_clean":"2024-09-22T03:14:34.802118+0000","last_became_active":"2024-09-22T03:13:29.557303+0000","last_became_peered":"2024-09-22T03:13:29.557303+0000","last_unstale":"2024-09-22T03:14:34.802118+0000","last_undegraded":"2024-09-22T03:14:34.802118+0000","last_fullsized":"2024-09-22T03:14:34.802118+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"54'1367","reported_seq":1380,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:35.616198+0000","last_change":"2024-09-22T03:13:29.549832+0000","last_active":"2024-09-22T03:14:35.616198+0000","last_peered":"2024-09-22T03:14:35.616198+0000","last_clean":"2024-09-22T03:14:35.616198+0000","last_became_active":"2024-09-22T03:13:29.525112+0000","last_became_peered":"2024-09-22T03:13:29.525112+0000","last_unstale":"2024-09-22T03:14:35.616198+0000","last_undegraded":"2024-09-22T03:14:35.616198+0000","last_fullsized":"2024-09-22T03:14:35.616198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1367,"log_dups_size":0,"ondisk_log_size":1367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1368,"num_write_kb":10944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"54'1151","reported_seq":1164,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:35.358658+0000","last_change":"2024-09-22T03:13:29.556621+0000","last_active":"2024-09-22T03:14:35.358658+0000","last_peered":"2024-09-22T03:14:35.358658+0000","last_clean":"2024-09-22T03:14:35.358658+0000","last_became_active":"2024-09-22T03:13:29.551982+0000","last_became_peered":"2024-09-22T03:13:29.551982+0000","last_unstale":"2024-09-22T03:14:35.358658+0000","last_undegraded":"2024-09-22T03:14:35.358658+0000","last_fullsized":"2024-09-22T03:14:35.358658+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"54'1271","reported_seq":1284,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:36.730319+0000","last_change":"2024-09-22T03:13:29.548744+0000","last_active":"2024-09-22T03:14:36.730319+0000","last_peered":"2024-09-22T03:14:36.730319+0000","last_clean":"2024-09-22T03:14:36.730319+0000","last_became_active":"2024-09-22T03:13:29.542670+0000","last_became_peered":"2024-09-22T03:13:29.542670+0000","last_unstale":"2024-09-22T03:14:36.730319+0000","last_undegraded":"2024-09-22T03:14:36.730319+0000","last_fullsized":"2024-09-22T03:14:36.730319+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"54'1103","reported_seq":1116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:35.087158+0000","last_change":"2024-09-22T03:13:29.547139+0000","last_active":"2024-09-22T03:14:35.087158+0000","last_peered":"2024-09-22T03:14:35.087158+0000","last_clean":"2024-09-22T03:14:35.087158+0000","last_became_active":"2024-09-22T03:13:29.541888+0000","last_became_peered":"2024-09-22T03:13:29.541888+0000","last_unstale":"2024-09-22T03:14:35.087158+0000","last_undegraded":"2024-09-22T03:14:35.087158+0000","last_fullsized":"2024-09-22T03:14:35.087158+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1103,"log_dups_size":0,"ondisk_log_size":1103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1104,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"54'1127","reported_seq":1140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:35.655267+0000","last_change":"2024-09-22T03:13:29.587411+0000","last_active":"2024-09-22T03:14:35.655267+0000","last_peered":"2024-09-22T03:14:35.655267+0000","last_clean":"2024-09-22T03:14:35.655267+0000","last_became_active":"2024-09-22T03:13:29.583366+0000","last_became_peered":"2024-09-22T03:13:29.583366+0000","last_unstale":"2024-09-22T03:14:35.655267+0000","last_undegraded":"2024-09-22T03:14:35.655267+0000","last_fullsized":"2024-09-22T03:14:35.655267+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'1375","reported_seq":1388,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:36.398837+0000","last_change":"2024-09-22T03:13:29.528163+0000","last_active":"2024-09-22T03:14:36.398837+0000","last_peered":"2024-09-22T03:14:36.398837+0000","last_clean":"2024-09-22T03:14:36.398837+0000","last_became_active":"2024-09-22T03:13:29.521737+0000","last_became_peered":"2024-09-22T03:13:29.521737+0000","last_unstale":"2024-09-22T03:14:36.398837+0000","last_undegraded":"2024-09-22T03:14:36.398837+0000","last_fullsized":"2024-09-22T03:14:36.398837+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1376,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"54'1127","reported_seq":1140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:34.309408+0000","last_change":"2024-09-22T03:13:29.566804+0000","last_active":"2024-09-22T03:14:34.309408+0000","last_peered":"2024-09-22T03:14:34.309408+0000","last_clean":"2024-09-22T03:14:34.309408+0000","last_became_active":"2024-09-22T03:13:29.560558+0000","last_became_peered":"2024-09-22T03:13:29.560558+0000","last_unstale":"2024-09-22T03:14:34.309408+0000","last_undegraded":"2024-09-22T03:14:34.309408+0000","last_fullsized":"2024-09-22T03:14:34.309408+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":156147712,"num_objects":2383,"num_object_clones":0,"num_object_copies":7149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19061,"num_write_kb":152488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":234778624,"data_stored":469557248,"data_compressed":24242604,"data_compressed_allocated":234778624,"data_compressed_original":469557248,"omap_allocated":0,"internal_metadata":0},"log_size":19045,"ondisk_log_size":19045,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123656,"kb_used_data":58488,"kb_used_omap":0,"kb_used_meta":65152,"kb_avail":94248184,"statfs":{"total":96636764160,"available":96510140416,"internally_reserved":0,"allocated":59891712,"data_stored":119009147,"data_compressed":6135699,"data_compressed_allocated":59420672,"data_compressed_original":118841344,"omap_allocated":0,"internal_metadata":66715648},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106492,"kb_used_data":43308,"kb_used_omap":0,"kb_used_meta":63168,"kb_avail":94265348,"statfs":{"total":96636764160,"available":96527716352,"internally_reserved":0,"allocated":44347392,"data_stored":88387995,"data_compressed":4554122,"data_compressed_allocated":43855872,"data_compressed_original":88203264,"omap_allocated":0,"internal_metadata":64684032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131524,"kb_used_data":67380,"kb_used_omap":0,"kb_used_meta":64128,"kb_avail":94240316,"statfs":{"total":96636764160,"available":96502083584,"internally_reserved":0,"allocated":68997120,"data_stored":137687451,"data_compressed":7099406,"data_compressed_allocated":68505600,"data_compressed_original":137502720,"omap_allocated":0,"internal_metadata":65667072},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706283,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137292,"kb_used_data":60732,"kb_used_omap":0,"kb_used_meta":76544,"kb_avail":94234548,"statfs":{"total":96636764160,"available":96496177152,"internally_reserved":0,"allocated":62189568,"data_stored":124080520,"data_compressed":6396899,"data_compressed_allocated":61702144,"data_compressed_original":123895808,"omap_allocated":0,"internal_metadata":78381056},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62083072,"data_stored":124166144,"data_compressed":6410508,"data_compressed_allocated":62083072,"data_compressed_original":124166144,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":68890624,"data_stored":137781248,"data_compressed":7113438,"data_compressed_allocated":68890624,"data_compressed_original":137781248,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":44072960,"data_stored":88145920,"data_compressed":4550811,"data_compressed_allocated":44072960,"data_compressed_original":88145920,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":59731968,"data_stored":119463936,"data_compressed":6167847,"data_compressed_allocated":59731968,"data_compressed_original":119463936,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:14:38.220 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:38.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:38.367+0000 7fe9a4d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:38.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:38.376+0000 7fe9a4d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:38.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 68 16 19622 19606 2.25235 1.97656 0.106216 0.0554706 2024-09-22T03:14:39.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 69 16 19863 19847 2.24699 1.88281 0.0638851 0.0555985 2024-09-22T03:14:40.495 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:40.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 70 16 20120 20104 2.24357 2.00781 0.0270898 0.0556956 2024-09-22T03:14:40.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:40.644+0000 7f6350d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:40.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:40.652+0000 7f6350d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:41.535 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 71 16 20347 20331 2.23695 1.77344 0.0989354 0.0558417 2024-09-22T03:14:42.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 72 16 20594 20578 2.23268 1.92969 0.0266845 0.055961 2024-09-22T03:14:42.700 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:14:42.700 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:14:42.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:14:42.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:42.833+0000 7f1d058ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:42.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:42.842+0000 7f1d058ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:42.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:42.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:42.963+0000 7f238710e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:42.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:42.971+0000 7f238710e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:14:43.141 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:14:43.159 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-09-22T03:14:42.800704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":166396467,"num_objects":2534,"num_object_clones":0,"num_object_copies":7602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":20379,"num_write_kb":163816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20324,"ondisk_log_size":20324,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":492984,"kb_used_data":244728,"kb_used_omap":0,"kb_used_meta":248192,"kb_avail":376994376,"statfs":{"total":386547056640,"available":386042241024,"internally_reserved":0,"allocated":250601472,"data_stored":499516473,"data_compressed":25753341,"data_compressed_allocated":248659968,"data_compressed_original":498794496,"omap_allocated":0,"internal_metadata":254148608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25198592,"num_objects":383,"num_object_clones":0,"num_object_copies":1149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3076,"num_write_kb":24608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002092"},"pg_stats":[{"pgid":"8.7","version":"54'1199","reported_seq":1212,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:41.367637+0000","last_change":"2024-09-22T03:13:29.529991+0000","last_active":"2024-09-22T03:14:41.367637+0000","last_peered":"2024-09-22T03:14:41.367637+0000","last_clean":"2024-09-22T03:14:41.367637+0000","last_became_active":"2024-09-22T03:13:29.525739+0000","last_became_peered":"2024-09-22T03:13:29.525739+0000","last_unstale":"2024-09-22T03:14:41.367637+0000","last_undegraded":"2024-09-22T03:14:41.367637+0000","last_fullsized":"2024-09-22T03:14:41.367637+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"54'1399","reported_seq":1412,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:41.324569+0000","last_change":"2024-09-22T03:13:29.531031+0000","last_active":"2024-09-22T03:14:41.324569+0000","last_peered":"2024-09-22T03:14:41.324569+0000","last_clean":"2024-09-22T03:14:41.324569+0000","last_became_active":"2024-09-22T03:13:29.526121+0000","last_became_peered":"2024-09-22T03:13:29.526121+0000","last_unstale":"2024-09-22T03:14:41.324569+0000","last_undegraded":"2024-09-22T03:14:41.324569+0000","last_fullsized":"2024-09-22T03:14:41.324569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1400,"num_write_kb":11200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"54'1031","reported_seq":1044,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:41.185947+0000","last_change":"2024-09-22T03:13:29.558419+0000","last_active":"2024-09-22T03:14:41.185947+0000","last_peered":"2024-09-22T03:14:41.185947+0000","last_clean":"2024-09-22T03:14:41.185947+0000","last_became_active":"2024-09-22T03:13:29.554453+0000","last_became_peered":"2024-09-22T03:13:29.554453+0000","last_unstale":"2024-09-22T03:14:41.185947+0000","last_undegraded":"2024-09-22T03:14:41.185947+0000","last_fullsized":"2024-09-22T03:14:41.185947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'1351","reported_seq":1364,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:40.399681+0000","last_change":"2024-09-22T03:13:29.576486+0000","last_active":"2024-09-22T03:14:40.399681+0000","last_peered":"2024-09-22T03:14:40.399681+0000","last_clean":"2024-09-22T03:14:40.399681+0000","last_became_active":"2024-09-22T03:13:29.572229+0000","last_became_peered":"2024-09-22T03:13:29.572229+0000","last_unstale":"2024-09-22T03:14:40.399681+0000","last_undegraded":"2024-09-22T03:14:40.399681+0000","last_fullsized":"2024-09-22T03:14:40.399681+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1351,"log_dups_size":0,"ondisk_log_size":1351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075584,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"54'1151","reported_seq":1164,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:40.678061+0000","last_change":"2024-09-22T03:13:29.555891+0000","last_active":"2024-09-22T03:14:40.678061+0000","last_peered":"2024-09-22T03:14:40.678061+0000","last_clean":"2024-09-22T03:14:40.678061+0000","last_became_active":"2024-09-22T03:13:29.530274+0000","last_became_peered":"2024-09-22T03:13:29.530274+0000","last_unstale":"2024-09-22T03:14:40.678061+0000","last_undegraded":"2024-09-22T03:14:40.678061+0000","last_fullsized":"2024-09-22T03:14:40.678061+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"54'1223","reported_seq":1236,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:40.468975+0000","last_change":"2024-09-22T03:13:29.535751+0000","last_active":"2024-09-22T03:14:40.468975+0000","last_peered":"2024-09-22T03:14:40.468975+0000","last_clean":"2024-09-22T03:14:40.468975+0000","last_became_active":"2024-09-22T03:13:29.528896+0000","last_became_peered":"2024-09-22T03:13:29.528896+0000","last_unstale":"2024-09-22T03:14:40.468975+0000","last_undegraded":"2024-09-22T03:14:40.468975+0000","last_fullsized":"2024-09-22T03:14:40.468975+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1223,"log_dups_size":0,"ondisk_log_size":1223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"54'1175","reported_seq":1188,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:40.795614+0000","last_change":"2024-09-22T03:13:29.533410+0000","last_active":"2024-09-22T03:14:40.795614+0000","last_peered":"2024-09-22T03:14:40.795614+0000","last_clean":"2024-09-22T03:14:40.795614+0000","last_became_active":"2024-09-22T03:13:29.524152+0000","last_became_peered":"2024-09-22T03:13:29.524152+0000","last_unstale":"2024-09-22T03:14:40.795614+0000","last_undegraded":"2024-09-22T03:14:40.795614+0000","last_fullsized":"2024-09-22T03:14:40.795614+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"54'1343","reported_seq":1356,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:41.507791+0000","last_change":"2024-09-22T03:13:29.574097+0000","last_active":"2024-09-22T03:14:41.507791+0000","last_peered":"2024-09-22T03:14:41.507791+0000","last_clean":"2024-09-22T03:14:41.507791+0000","last_became_active":"2024-09-22T03:13:29.566300+0000","last_became_peered":"2024-09-22T03:13:29.566300+0000","last_unstale":"2024-09-22T03:14:41.507791+0000","last_undegraded":"2024-09-22T03:14:41.507791+0000","last_fullsized":"2024-09-22T03:14:41.507791+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11010048,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":10752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"54'1303","reported_seq":1316,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:40.355499+0000","last_change":"2024-09-22T03:13:29.560741+0000","last_active":"2024-09-22T03:14:40.355499+0000","last_peered":"2024-09-22T03:14:40.355499+0000","last_clean":"2024-09-22T03:14:40.355499+0000","last_became_active":"2024-09-22T03:13:29.557303+0000","last_became_peered":"2024-09-22T03:13:29.557303+0000","last_unstale":"2024-09-22T03:14:40.355499+0000","last_undegraded":"2024-09-22T03:14:40.355499+0000","last_fullsized":"2024-09-22T03:14:40.355499+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"54'1439","reported_seq":1452,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:41.574701+0000","last_change":"2024-09-22T03:13:29.549832+0000","last_active":"2024-09-22T03:14:41.574701+0000","last_peered":"2024-09-22T03:14:41.574701+0000","last_clean":"2024-09-22T03:14:41.574701+0000","last_became_active":"2024-09-22T03:13:29.525112+0000","last_became_peered":"2024-09-22T03:13:29.525112+0000","last_unstale":"2024-09-22T03:14:41.574701+0000","last_undegraded":"2024-09-22T03:14:41.574701+0000","last_fullsized":"2024-09-22T03:14:41.574701+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1440,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"54'1207","reported_seq":1220,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:39.166434+0000","last_change":"2024-09-22T03:13:29.556621+0000","last_active":"2024-09-22T03:14:39.166434+0000","last_peered":"2024-09-22T03:14:39.166434+0000","last_clean":"2024-09-22T03:14:39.166434+0000","last_became_active":"2024-09-22T03:13:29.551982+0000","last_became_peered":"2024-09-22T03:13:29.551982+0000","last_unstale":"2024-09-22T03:14:39.166434+0000","last_undegraded":"2024-09-22T03:14:39.166434+0000","last_fullsized":"2024-09-22T03:14:39.166434+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1207,"log_dups_size":0,"ondisk_log_size":1207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"54'1359","reported_seq":1372,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:40.756909+0000","last_change":"2024-09-22T03:13:29.548744+0000","last_active":"2024-09-22T03:14:40.756909+0000","last_peered":"2024-09-22T03:14:40.756909+0000","last_clean":"2024-09-22T03:14:40.756909+0000","last_became_active":"2024-09-22T03:13:29.542670+0000","last_became_peered":"2024-09-22T03:13:29.542670+0000","last_unstale":"2024-09-22T03:14:40.756909+0000","last_undegraded":"2024-09-22T03:14:40.756909+0000","last_fullsized":"2024-09-22T03:14:40.756909+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1359,"log_dups_size":0,"ondisk_log_size":1359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"54'1151","reported_seq":1164,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:39.434212+0000","last_change":"2024-09-22T03:13:29.547139+0000","last_active":"2024-09-22T03:14:39.434212+0000","last_peered":"2024-09-22T03:14:39.434212+0000","last_clean":"2024-09-22T03:14:39.434212+0000","last_became_active":"2024-09-22T03:13:29.541888+0000","last_became_peered":"2024-09-22T03:13:29.541888+0000","last_unstale":"2024-09-22T03:14:39.434212+0000","last_undegraded":"2024-09-22T03:14:39.434212+0000","last_fullsized":"2024-09-22T03:14:39.434212+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"54'1191","reported_seq":1204,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:40.559473+0000","last_change":"2024-09-22T03:13:29.587411+0000","last_active":"2024-09-22T03:14:40.559473+0000","last_peered":"2024-09-22T03:14:40.559473+0000","last_clean":"2024-09-22T03:14:40.559473+0000","last_became_active":"2024-09-22T03:13:29.583366+0000","last_became_peered":"2024-09-22T03:13:29.583366+0000","last_unstale":"2024-09-22T03:14:40.559473+0000","last_undegraded":"2024-09-22T03:14:40.559473+0000","last_fullsized":"2024-09-22T03:14:40.559473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'1455","reported_seq":1468,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:41.275750+0000","last_change":"2024-09-22T03:13:29.528163+0000","last_active":"2024-09-22T03:14:41.275750+0000","last_peered":"2024-09-22T03:14:41.275750+0000","last_clean":"2024-09-22T03:14:41.275750+0000","last_became_active":"2024-09-22T03:13:29.521737+0000","last_became_peered":"2024-09-22T03:13:29.521737+0000","last_unstale":"2024-09-22T03:14:41.275750+0000","last_undegraded":"2024-09-22T03:14:41.275750+0000","last_fullsized":"2024-09-22T03:14:41.275750+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1455,"log_dups_size":0,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"54'1247","reported_seq":1260,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:40.737710+0000","last_change":"2024-09-22T03:13:29.566804+0000","last_active":"2024-09-22T03:14:40.737710+0000","last_peered":"2024-09-22T03:14:40.737710+0000","last_clean":"2024-09-22T03:14:40.737710+0000","last_became_active":"2024-09-22T03:13:29.560558+0000","last_became_peered":"2024-09-22T03:13:29.560558+0000","last_unstale":"2024-09-22T03:14:40.737710+0000","last_undegraded":"2024-09-22T03:14:40.737710+0000","last_fullsized":"2024-09-22T03:14:40.737710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1247,"log_dups_size":0,"ondisk_log_size":1247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":9984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":165806080,"num_objects":2530,"num_object_clones":0,"num_object_copies":7590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20240,"num_write_kb":161920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":249692160,"data_stored":499384320,"data_compressed":25782747,"data_compressed_allocated":249692160,"data_compressed_original":499384320,"omap_allocated":0,"internal_metadata":0},"log_size":20224,"ondisk_log_size":20224,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131712,"kb_used_data":62384,"kb_used_omap":0,"kb_used_meta":69312,"kb_avail":94240128,"statfs":{"total":96636764160,"available":96501891072,"internally_reserved":0,"allocated":63881216,"data_stored":126988155,"data_compressed":6547701,"data_compressed_allocated":63410176,"data_compressed_original":126820352,"omap_allocated":0,"internal_metadata":70975488},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92656,"kb_used_data":46112,"kb_used_omap":0,"kb_used_meta":46528,"kb_avail":94279184,"statfs":{"total":96636764160,"available":96541884416,"internally_reserved":0,"allocated":47218688,"data_stored":94130587,"data_compressed":4850645,"data_compressed_allocated":46727168,"data_compressed_original":93945856,"omap_allocated":0,"internal_metadata":47644672},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139748,"kb_used_data":71444,"kb_used_omap":0,"kb_used_meta":68288,"kb_avail":94232092,"statfs":{"total":96636764160,"available":96493662208,"internally_reserved":0,"allocated":73158656,"data_stored":146010523,"data_compressed":7529174,"data_compressed_allocated":72667136,"data_compressed_original":145825792,"omap_allocated":0,"internal_metadata":69926912},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706288,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128868,"kb_used_data":64788,"kb_used_omap":0,"kb_used_meta":64064,"kb_avail":94242972,"statfs":{"total":96636764160,"available":96504803328,"internally_reserved":0,"allocated":66342912,"data_stored":132387208,"data_compressed":6825821,"data_compressed_allocated":65855488,"data_compressed_original":132202496,"omap_allocated":0,"internal_metadata":65601536},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":66232320,"data_stored":132464640,"data_compressed":6839007,"data_compressed_allocated":66232320,"data_compressed_original":132464640,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":72929280,"data_stored":145858560,"data_compressed":7530516,"data_compressed_allocated":72929280,"data_compressed_original":145858560,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":46866432,"data_stored":93732864,"data_compressed":4839297,"data_compressed_allocated":46866432,"data_compressed_original":93732864,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":63664128,"data_stored":127328256,"data_compressed":6573927,"data_compressed_allocated":63664128,"data_compressed_original":127328256,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:14:43.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 73 16 20844 20828 2.22885 1.95312 0.0353498 0.056057 2024-09-22T03:14:44.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 74 16 21100 21084 2.22575 2 0.0538037 0.0561354 2024-09-22T03:14:45.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:45.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:45.263+0000 7fde5f82c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:45.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:45.268+0000 7fde5f82c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:45.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 75 16 21343 21327 2.22139 1.89844 0.029963 0.0562368 2024-09-22T03:14:46.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 76 16 21563 21547 2.21477 1.71875 0.0520155 0.0564087 2024-09-22T03:14:47.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:47.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:47.527+0000 7f0627517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:47.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:47.533+0000 7f0627517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:47.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 77 16 21785 21769 2.20853 1.73438 0.0745823 0.0565416 2024-09-22T03:14:48.161 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:14:48.161 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:14:48.161 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:14:48.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:14:48.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:48.279+0000 7f51afc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:48.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:48.288+0000 7f51afc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:48.334 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:48.334 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:48.334 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:48.334 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:48.334 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:48.334 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:48.334 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:48.335 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:48.335 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:48.335 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:48.335 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:48.335 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:48.338 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:48.339 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:48.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:14:48.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:48.481+0000 7f8141517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:48.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:48.491+0000 7f8141517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:48.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 78 16 22029 22013 2.20465 1.90625 0.0470353 0.0566604 2024-09-22T03:14:48.544 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:48.544 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:48.544 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:48.544 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:48.544 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:48.544 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:48.544 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:48.544 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:48.544 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:48.544 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:48.545 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:48.545 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:48.547 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:48.548 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:48.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:14:48.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:48.685+0000 7fbfaa717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:48.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:48.697+0000 7fbfaa717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:48.753 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:48.753 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:48.753 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:48.753 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:48.753 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:48.753 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:48.753 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:48.753 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:48.753 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:48.753 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:48.754 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:48.754 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:48.757 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:48.757 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:48.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:14:48.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:48.874+0000 7fc3274a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:48.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:48.885+0000 7fc3274a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:48.901 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:48.901 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:48.901 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:48.901 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:48.902 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:48.902 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:48.902 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:48.902 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:48.902 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:48.902 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:48.902 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:48.902 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:48.905 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:48.905 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:49.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 79 16 22259 22243 2.19949 1.79688 0.0314374 0.0567994 2024-09-22T03:14:49.670 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:49.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:49.797+0000 7fdd73f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:49.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:49.803+0000 7fdd73f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:50.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:14:50.535801+0000 min lat: 0.00843874 max lat: 0.208346 avg lat: 0.0569663 2024-09-22T03:14:50.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:14:50.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 80 16 22470 22454 2.1926 1.64844 0.0728004 0.0569663 2024-09-22T03:14:51.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 81 16 22698 22682 2.18752 1.78125 0.0229563 0.0571025 2024-09-22T03:14:51.919 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:52.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:52.043+0000 7f507762c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:52.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:52.048+0000 7f507762c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:52.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 82 16 22916 22900 2.18161 1.70312 0.0585553 0.0572648 2024-09-22T03:14:53.537 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 83 16 23154 23138 2.17772 1.85938 0.0529291 0.0573621 2024-09-22T03:14:53.906 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:14:53.906 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:14:53.906 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:14:53.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:14:54.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:54.046+0000 7f96fe557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:54.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:54.054+0000 7f96fe557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:54.081 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:54.081 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:54.083 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:54.084 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:54.084 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:14:54.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:54.200+0000 7fa2a7797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:54.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:54.208+0000 7fa2a7797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:54.237 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:54.238 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:54.238 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:54.238 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:54.238 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:54.238 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:54.238 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:54.238 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:54.238 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:54.238 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:54.238 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:54.238 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:54.241 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:54.241 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:54.241 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:14:54.326 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:54.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:54.368+0000 7fe2e6917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:54.378+0000 7fe2e6917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:54.444 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:54.444 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:54.444 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:54.448 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:54.449 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:54.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:14:54.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:54.474+0000 7f6efcd17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:54.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:54.480+0000 7f6efcd17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:54.536 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 84 16 23373 23357 2.17217 1.71094 0.0906894 0.0575071 2024-09-22T03:14:54.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:54.581+0000 7fa9790c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:54.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:54.590+0000 7fa9790c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:54.607 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:14:54.607 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:14:54.607 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:14:54.607 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:14:54.607 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:14:54.607 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:14:54.607 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:14:54.607 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:14:54.607 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:14:54.607 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:14:54.607 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:14:54.608 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:14:54.610 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:14:54.610 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:14:55.537 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 85 16 23601 23585 2.16757 1.78125 0.0760195 0.0576478 2024-09-22T03:14:56.537 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 86 16 23833 23817 2.16343 1.8125 0.0215046 0.0577441 2024-09-22T03:14:56.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:14:56.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:56.754+0000 7fb750f0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:56.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:56.759+0000 7fb750f0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:57.537 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 87 16 24082 24066 2.16093 1.94531 0.0877258 0.0578159 2024-09-22T03:14:58.537 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 88 16 24325 24309 2.15794 1.89844 0.0760735 0.0578772 2024-09-22T03:14:58.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:14:59.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:59.031+0000 7ff815d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:59.036+0000 7ff815d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:59.537 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 89 16 24518 24502 2.15064 1.50781 0.136908 0.0580701 2024-09-22T03:14:59.611 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:14:59.611 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:14:59.611 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:14:59.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:59.732+0000 7fd557997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:59.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:14:59.740+0000 7fd557997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:14:59.999 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:14:59.999 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:15:00.012 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-09-22T03:14:58.803380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":195289651,"num_objects":2976,"num_object_clones":0,"num_object_copies":8928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":23906,"num_write_kb":192032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23851,"ondisk_log_size":23851,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":582032,"kb_used_data":286608,"kb_used_omap":0,"kb_used_meta":295360,"kb_avail":376905328,"statfs":{"total":386547056640,"available":385951055872,"internally_reserved":0,"allocated":293486592,"data_stored":585286713,"data_compressed":30182148,"data_compressed_allocated":291545088,"data_compressed_original":584564736,"omap_allocated":0,"internal_metadata":302448640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18571264,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2267,"num_write_kb":18136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002085"},"pg_stats":[{"pgid":"8.7","version":"54'1399","reported_seq":1412,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:56.634073+0000","last_change":"2024-09-22T03:13:29.529991+0000","last_active":"2024-09-22T03:14:56.634073+0000","last_peered":"2024-09-22T03:14:56.634073+0000","last_clean":"2024-09-22T03:14:56.634073+0000","last_became_active":"2024-09-22T03:13:29.525739+0000","last_became_peered":"2024-09-22T03:13:29.525739+0000","last_unstale":"2024-09-22T03:14:56.634073+0000","last_undegraded":"2024-09-22T03:14:56.634073+0000","last_fullsized":"2024-09-22T03:14:56.634073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1400,"num_write_kb":11200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"54'1645","reported_seq":1658,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:56.746806+0000","last_change":"2024-09-22T03:13:29.531031+0000","last_active":"2024-09-22T03:14:56.746806+0000","last_peered":"2024-09-22T03:14:56.746806+0000","last_clean":"2024-09-22T03:14:56.746806+0000","last_became_active":"2024-09-22T03:13:29.526121+0000","last_became_peered":"2024-09-22T03:13:29.526121+0000","last_unstale":"2024-09-22T03:14:56.746806+0000","last_undegraded":"2024-09-22T03:14:56.746806+0000","last_fullsized":"2024-09-22T03:14:56.746806+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1645,"log_dups_size":0,"ondisk_log_size":1645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13484032,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1646,"num_write_kb":13168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"54'1215","reported_seq":1228,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:55.082248+0000","last_change":"2024-09-22T03:13:29.558419+0000","last_active":"2024-09-22T03:14:55.082248+0000","last_peered":"2024-09-22T03:14:55.082248+0000","last_clean":"2024-09-22T03:14:55.082248+0000","last_became_active":"2024-09-22T03:13:29.554453+0000","last_became_peered":"2024-09-22T03:13:29.554453+0000","last_unstale":"2024-09-22T03:14:55.082248+0000","last_undegraded":"2024-09-22T03:14:55.082248+0000","last_fullsized":"2024-09-22T03:14:55.082248+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'1528","reported_seq":1541,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:55.633538+0000","last_change":"2024-09-22T03:13:29.576486+0000","last_active":"2024-09-22T03:14:55.633538+0000","last_peered":"2024-09-22T03:14:55.633538+0000","last_clean":"2024-09-22T03:14:55.633538+0000","last_became_active":"2024-09-22T03:13:29.572229+0000","last_became_peered":"2024-09-22T03:13:29.572229+0000","last_unstale":"2024-09-22T03:14:55.633538+0000","last_undegraded":"2024-09-22T03:14:55.633538+0000","last_fullsized":"2024-09-22T03:14:55.633538+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12525568,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1529,"num_write_kb":12232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"54'1303","reported_seq":1316,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:55.600828+0000","last_change":"2024-09-22T03:13:29.555891+0000","last_active":"2024-09-22T03:14:55.600828+0000","last_peered":"2024-09-22T03:14:55.600828+0000","last_clean":"2024-09-22T03:14:55.600828+0000","last_became_active":"2024-09-22T03:13:29.530274+0000","last_became_peered":"2024-09-22T03:13:29.530274+0000","last_unstale":"2024-09-22T03:14:55.600828+0000","last_undegraded":"2024-09-22T03:14:55.600828+0000","last_fullsized":"2024-09-22T03:14:55.600828+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"54'1391","reported_seq":1404,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:55.488700+0000","last_change":"2024-09-22T03:13:29.535751+0000","last_active":"2024-09-22T03:14:55.488700+0000","last_peered":"2024-09-22T03:14:55.488700+0000","last_clean":"2024-09-22T03:14:55.488700+0000","last_became_active":"2024-09-22T03:13:29.528896+0000","last_became_peered":"2024-09-22T03:13:29.528896+0000","last_unstale":"2024-09-22T03:14:55.488700+0000","last_undegraded":"2024-09-22T03:14:55.488700+0000","last_fullsized":"2024-09-22T03:14:55.488700+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1392,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"54'1351","reported_seq":1364,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:56.687908+0000","last_change":"2024-09-22T03:13:29.533410+0000","last_active":"2024-09-22T03:14:56.687908+0000","last_peered":"2024-09-22T03:14:56.687908+0000","last_clean":"2024-09-22T03:14:56.687908+0000","last_became_active":"2024-09-22T03:13:29.524152+0000","last_became_peered":"2024-09-22T03:13:29.524152+0000","last_unstale":"2024-09-22T03:14:56.687908+0000","last_undegraded":"2024-09-22T03:14:56.687908+0000","last_fullsized":"2024-09-22T03:14:56.687908+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1351,"log_dups_size":0,"ondisk_log_size":1351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075584,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"54'1551","reported_seq":1564,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:56.349471+0000","last_change":"2024-09-22T03:13:29.574097+0000","last_active":"2024-09-22T03:14:56.349471+0000","last_peered":"2024-09-22T03:14:56.349471+0000","last_clean":"2024-09-22T03:14:56.349471+0000","last_became_active":"2024-09-22T03:13:29.566300+0000","last_became_peered":"2024-09-22T03:13:29.566300+0000","last_unstale":"2024-09-22T03:14:56.349471+0000","last_undegraded":"2024-09-22T03:14:56.349471+0000","last_fullsized":"2024-09-22T03:14:56.349471+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1551,"log_dups_size":0,"ondisk_log_size":1551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1552,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"54'1631","reported_seq":1644,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:55.758246+0000","last_change":"2024-09-22T03:13:29.560741+0000","last_active":"2024-09-22T03:14:55.758246+0000","last_peered":"2024-09-22T03:14:55.758246+0000","last_clean":"2024-09-22T03:14:55.758246+0000","last_became_active":"2024-09-22T03:13:29.557303+0000","last_became_peered":"2024-09-22T03:13:29.557303+0000","last_unstale":"2024-09-22T03:14:55.758246+0000","last_undegraded":"2024-09-22T03:14:55.758246+0000","last_fullsized":"2024-09-22T03:14:55.758246+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1631,"log_dups_size":0,"ondisk_log_size":1631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1632,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"54'1703","reported_seq":1716,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:56.448146+0000","last_change":"2024-09-22T03:13:29.549832+0000","last_active":"2024-09-22T03:14:56.448146+0000","last_peered":"2024-09-22T03:14:56.448146+0000","last_clean":"2024-09-22T03:14:56.448146+0000","last_became_active":"2024-09-22T03:13:29.525112+0000","last_became_peered":"2024-09-22T03:13:29.525112+0000","last_unstale":"2024-09-22T03:14:56.448146+0000","last_undegraded":"2024-09-22T03:14:56.448146+0000","last_fullsized":"2024-09-22T03:14:56.448146+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1703,"log_dups_size":0,"ondisk_log_size":1703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1704,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"54'1455","reported_seq":1468,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:55.699325+0000","last_change":"2024-09-22T03:13:29.556621+0000","last_active":"2024-09-22T03:14:55.699325+0000","last_peered":"2024-09-22T03:14:55.699325+0000","last_clean":"2024-09-22T03:14:55.699325+0000","last_became_active":"2024-09-22T03:13:29.551982+0000","last_became_peered":"2024-09-22T03:13:29.551982+0000","last_unstale":"2024-09-22T03:14:55.699325+0000","last_undegraded":"2024-09-22T03:14:55.699325+0000","last_fullsized":"2024-09-22T03:14:55.699325+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1455,"log_dups_size":0,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"54'1623","reported_seq":1636,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:56.708473+0000","last_change":"2024-09-22T03:13:29.548744+0000","last_active":"2024-09-22T03:14:56.708473+0000","last_peered":"2024-09-22T03:14:56.708473+0000","last_clean":"2024-09-22T03:14:56.708473+0000","last_became_active":"2024-09-22T03:13:29.542670+0000","last_became_peered":"2024-09-22T03:13:29.542670+0000","last_unstale":"2024-09-22T03:14:56.708473+0000","last_undegraded":"2024-09-22T03:14:56.708473+0000","last_fullsized":"2024-09-22T03:14:56.708473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1623,"log_dups_size":0,"ondisk_log_size":1623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1624,"num_write_kb":12992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"54'1391","reported_seq":1404,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:55.339005+0000","last_change":"2024-09-22T03:13:29.547139+0000","last_active":"2024-09-22T03:14:55.339005+0000","last_peered":"2024-09-22T03:14:55.339005+0000","last_clean":"2024-09-22T03:14:55.339005+0000","last_became_active":"2024-09-22T03:13:29.541888+0000","last_became_peered":"2024-09-22T03:13:29.541888+0000","last_unstale":"2024-09-22T03:14:55.339005+0000","last_undegraded":"2024-09-22T03:14:55.339005+0000","last_fullsized":"2024-09-22T03:14:55.339005+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1392,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"54'1359","reported_seq":1372,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:55.167369+0000","last_change":"2024-09-22T03:13:29.587411+0000","last_active":"2024-09-22T03:14:55.167369+0000","last_peered":"2024-09-22T03:14:55.167369+0000","last_clean":"2024-09-22T03:14:55.167369+0000","last_became_active":"2024-09-22T03:13:29.583366+0000","last_became_peered":"2024-09-22T03:13:29.583366+0000","last_unstale":"2024-09-22T03:14:55.167369+0000","last_undegraded":"2024-09-22T03:14:55.167369+0000","last_fullsized":"2024-09-22T03:14:55.167369+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1359,"log_dups_size":0,"ondisk_log_size":1359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'1735","reported_seq":1748,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:56.596562+0000","last_change":"2024-09-22T03:13:29.528163+0000","last_active":"2024-09-22T03:14:56.596562+0000","last_peered":"2024-09-22T03:14:56.596562+0000","last_clean":"2024-09-22T03:14:56.596562+0000","last_became_active":"2024-09-22T03:13:29.521737+0000","last_became_peered":"2024-09-22T03:13:29.521737+0000","last_unstale":"2024-09-22T03:14:56.596562+0000","last_undegraded":"2024-09-22T03:14:56.596562+0000","last_fullsized":"2024-09-22T03:14:56.596562+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1736,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"54'1471","reported_seq":1484,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:54.696390+0000","last_change":"2024-09-22T03:13:29.566804+0000","last_active":"2024-09-22T03:14:54.696390+0000","last_peered":"2024-09-22T03:14:54.696390+0000","last_clean":"2024-09-22T03:14:54.696390+0000","last_became_active":"2024-09-22T03:13:29.560558+0000","last_became_peered":"2024-09-22T03:13:29.560558+0000","last_unstale":"2024-09-22T03:14:54.696390+0000","last_undegraded":"2024-09-22T03:14:54.696390+0000","last_fullsized":"2024-09-22T03:14:54.696390+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1471,"log_dups_size":0,"ondisk_log_size":1471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":194699264,"num_objects":2972,"num_object_clones":0,"num_object_copies":8916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23767,"num_write_kb":190136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292794368,"data_stored":585588736,"data_compressed":30233973,"data_compressed_allocated":292794368,"data_compressed_original":585588736,"omap_allocated":0,"internal_metadata":0},"log_size":23751,"ondisk_log_size":23751,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":155964,"kb_used_data":72748,"kb_used_omap":0,"kb_used_meta":83200,"kb_avail":94215876,"statfs":{"total":96636764160,"available":96477057024,"internally_reserved":0,"allocated":74493952,"data_stored":148213627,"data_compressed":7643693,"data_compressed_allocated":74022912,"data_compressed_original":148045824,"omap_allocated":0,"internal_metadata":85196800},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":109268,"kb_used_data":54404,"kb_used_omap":0,"kb_used_meta":54848,"kb_avail":94262572,"statfs":{"total":96636764160,"available":96524873728,"internally_reserved":0,"allocated":55709696,"data_stored":111112603,"data_compressed":5727523,"data_compressed_allocated":55218176,"data_compressed_original":110927872,"omap_allocated":0,"internal_metadata":56164352},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":164288,"kb_used_data":83504,"kb_used_omap":0,"kb_used_meta":80768,"kb_avail":94207552,"statfs":{"total":96636764160,"available":96468533248,"internally_reserved":0,"allocated":85508096,"data_stored":170709403,"data_compressed":8804518,"data_compressed_allocated":85016576,"data_compressed_original":170524672,"omap_allocated":0,"internal_metadata":82706432},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706303,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":152512,"kb_used_data":75952,"kb_used_omap":0,"kb_used_meta":76544,"kb_avail":94219328,"statfs":{"total":96636764160,"available":96480591872,"internally_reserved":0,"allocated":77774848,"data_stored":155251080,"data_compressed":8006414,"data_compressed_allocated":77287424,"data_compressed_original":155066368,"omap_allocated":0,"internal_metadata":78381056},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77615104,"data_stored":155230208,"data_compressed":8014524,"data_compressed_allocated":77615104,"data_compressed_original":155230208,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85327872,"data_stored":170655744,"data_compressed":8810936,"data_compressed_allocated":85327872,"data_compressed_original":170655744,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55496704,"data_stored":110993408,"data_compressed":5730557,"data_compressed_allocated":55496704,"data_compressed_original":110993408,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":74354688,"data_stored":148709376,"data_compressed":7677956,"data_compressed_allocated":74354688,"data_compressed_original":148709376,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:15:00.537 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 90 16 24730 24714 2.14514 1.65625 0.0644272 0.0582368 2024-09-22T03:15:01.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:01.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:01.261+0000 7fa65d917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:01.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:01.265+0000 7fa65d917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:01.537 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total time run: 90.0855 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total writes made: 24730 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Write size: 8192 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object size: 65536 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Bandwidth (MB/sec): 2.14466 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Bandwidth: 0.309554 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max bandwidth (MB/sec): 2.75781 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min bandwidth (MB/sec): 1.50781 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average IOPS: 274 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev IOPS: 39.6229 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max IOPS: 353 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min IOPS: 193 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average Latency(s): 0.0582577 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Latency(s): 0.0270174 2024-09-22T03:15:01.538 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max latency(s): 0.208346 2024-09-22T03:15:01.539 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min latency(s): 0.00843874 2024-09-22T03:15:01.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:15:03.338 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:03.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:03.481+0000 7f756d46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:03.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:03.489+0000 7f756d46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:05.014 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:15:05.014 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:15:05.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:15:05.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:05.149+0000 7f4f80d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:05.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:05.162+0000 7f4f80d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:05.479 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:15:05.480 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:15:05.499 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":371,"stamp":"2024-09-22T03:15:04.804604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":200688179,"num_objects":3058,"num_object_clones":0,"num_object_copies":9174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":24907,"num_write_kb":199736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24852,"ondisk_log_size":24852,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":594032,"kb_used_data":298608,"kb_used_omap":0,"kb_used_meta":295360,"kb_avail":376893328,"statfs":{"total":386547056640,"available":385938767872,"internally_reserved":0,"allocated":305774592,"data_stored":609862713,"data_compressed":31451148,"data_compressed_allocated":303833088,"data_compressed_original":609140736,"omap_allocated":0,"internal_metadata":302448640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14254080,"num_objects":218,"num_object_clones":0,"num_object_copies":654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2082,"num_write_kb":16352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002265"},"pg_stats":[{"pgid":"8.7","version":"54'1444","reported_seq":1457,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:01.683238+0000","last_change":"2024-09-22T03:13:29.529991+0000","last_active":"2024-09-22T03:15:01.683238+0000","last_peered":"2024-09-22T03:15:01.683238+0000","last_clean":"2024-09-22T03:15:01.683238+0000","last_became_active":"2024-09-22T03:13:29.525739+0000","last_became_peered":"2024-09-22T03:13:29.525739+0000","last_unstale":"2024-09-22T03:15:01.683238+0000","last_undegraded":"2024-09-22T03:15:01.683238+0000","last_fullsized":"2024-09-22T03:15:01.683238+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1444,"log_dups_size":0,"ondisk_log_size":1444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1445,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"54'1718","reported_seq":1731,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:01.723089+0000","last_change":"2024-09-22T03:13:29.531031+0000","last_active":"2024-09-22T03:15:01.723089+0000","last_peered":"2024-09-22T03:15:01.723089+0000","last_clean":"2024-09-22T03:15:01.723089+0000","last_became_active":"2024-09-22T03:13:29.526121+0000","last_became_peered":"2024-09-22T03:13:29.526121+0000","last_unstale":"2024-09-22T03:15:01.723089+0000","last_undegraded":"2024-09-22T03:15:01.723089+0000","last_fullsized":"2024-09-22T03:15:01.723089+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1718,"log_dups_size":0,"ondisk_log_size":1718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13565952,"num_objects":207,"num_object_clones":0,"num_object_copies":621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1719,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"54'1301","reported_seq":1314,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:01.756051+0000","last_change":"2024-09-22T03:13:29.558419+0000","last_active":"2024-09-22T03:15:01.756051+0000","last_peered":"2024-09-22T03:15:01.756051+0000","last_clean":"2024-09-22T03:15:01.756051+0000","last_became_active":"2024-09-22T03:13:29.554453+0000","last_became_peered":"2024-09-22T03:13:29.554453+0000","last_unstale":"2024-09-22T03:15:01.756051+0000","last_undegraded":"2024-09-22T03:15:01.756051+0000","last_fullsized":"2024-09-22T03:15:01.756051+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1301,"log_dups_size":0,"ondisk_log_size":1301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1302,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'1601","reported_seq":1614,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:00.574978+0000","last_change":"2024-09-22T03:13:29.576486+0000","last_active":"2024-09-22T03:15:00.574978+0000","last_peered":"2024-09-22T03:15:00.574978+0000","last_clean":"2024-09-22T03:15:00.574978+0000","last_became_active":"2024-09-22T03:13:29.572229+0000","last_became_peered":"2024-09-22T03:13:29.572229+0000","last_unstale":"2024-09-22T03:15:00.574978+0000","last_undegraded":"2024-09-22T03:15:00.574978+0000","last_fullsized":"2024-09-22T03:15:00.574978+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13123584,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1602,"num_write_kb":12816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"54'1362","reported_seq":1375,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:01.720326+0000","last_change":"2024-09-22T03:13:29.555891+0000","last_active":"2024-09-22T03:15:01.720326+0000","last_peered":"2024-09-22T03:15:01.720326+0000","last_clean":"2024-09-22T03:15:01.720326+0000","last_became_active":"2024-09-22T03:13:29.530274+0000","last_became_peered":"2024-09-22T03:13:29.530274+0000","last_unstale":"2024-09-22T03:15:01.720326+0000","last_undegraded":"2024-09-22T03:15:01.720326+0000","last_fullsized":"2024-09-22T03:15:01.720326+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1362,"log_dups_size":0,"ondisk_log_size":1362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"54'1487","reported_seq":1500,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:00.269362+0000","last_change":"2024-09-22T03:13:29.535751+0000","last_active":"2024-09-22T03:15:00.269362+0000","last_peered":"2024-09-22T03:15:00.269362+0000","last_clean":"2024-09-22T03:15:00.269362+0000","last_became_active":"2024-09-22T03:13:29.528896+0000","last_became_peered":"2024-09-22T03:13:29.528896+0000","last_unstale":"2024-09-22T03:15:00.269362+0000","last_undegraded":"2024-09-22T03:15:00.269362+0000","last_fullsized":"2024-09-22T03:15:00.269362+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1488,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"54'1392","reported_seq":1405,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:59.925752+0000","last_change":"2024-09-22T03:13:29.533410+0000","last_active":"2024-09-22T03:14:59.925752+0000","last_peered":"2024-09-22T03:14:59.925752+0000","last_clean":"2024-09-22T03:14:59.925752+0000","last_became_active":"2024-09-22T03:13:29.524152+0000","last_became_peered":"2024-09-22T03:13:29.524152+0000","last_unstale":"2024-09-22T03:14:59.925752+0000","last_undegraded":"2024-09-22T03:14:59.925752+0000","last_fullsized":"2024-09-22T03:14:59.925752+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1392,"log_dups_size":0,"ondisk_log_size":1392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11337728,"num_objects":173,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1393,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"54'1611","reported_seq":1624,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:01.644426+0000","last_change":"2024-09-22T03:13:29.574097+0000","last_active":"2024-09-22T03:15:01.644426+0000","last_peered":"2024-09-22T03:15:01.644426+0000","last_clean":"2024-09-22T03:15:01.644426+0000","last_became_active":"2024-09-22T03:13:29.566300+0000","last_became_peered":"2024-09-22T03:13:29.566300+0000","last_unstale":"2024-09-22T03:15:01.644426+0000","last_undegraded":"2024-09-22T03:15:01.644426+0000","last_fullsized":"2024-09-22T03:15:01.644426+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1611,"log_dups_size":0,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1612,"num_write_kb":12864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"54'1703","reported_seq":1716,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:00.228745+0000","last_change":"2024-09-22T03:13:29.560741+0000","last_active":"2024-09-22T03:15:00.228745+0000","last_peered":"2024-09-22T03:15:00.228745+0000","last_clean":"2024-09-22T03:15:00.228745+0000","last_became_active":"2024-09-22T03:13:29.557303+0000","last_became_peered":"2024-09-22T03:13:29.557303+0000","last_unstale":"2024-09-22T03:15:00.228745+0000","last_undegraded":"2024-09-22T03:15:00.228745+0000","last_fullsized":"2024-09-22T03:15:00.228745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1703,"log_dups_size":0,"ondisk_log_size":1703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1704,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"54'1756","reported_seq":1769,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:01.700070+0000","last_change":"2024-09-22T03:13:29.549832+0000","last_active":"2024-09-22T03:15:01.700070+0000","last_peered":"2024-09-22T03:15:01.700070+0000","last_clean":"2024-09-22T03:15:01.700070+0000","last_became_active":"2024-09-22T03:13:29.525112+0000","last_became_peered":"2024-09-22T03:13:29.525112+0000","last_unstale":"2024-09-22T03:15:01.700070+0000","last_undegraded":"2024-09-22T03:15:01.700070+0000","last_fullsized":"2024-09-22T03:15:01.700070+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1757,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"54'1471","reported_seq":1484,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:00.595006+0000","last_change":"2024-09-22T03:13:29.556621+0000","last_active":"2024-09-22T03:15:00.595006+0000","last_peered":"2024-09-22T03:15:00.595006+0000","last_clean":"2024-09-22T03:15:00.595006+0000","last_became_active":"2024-09-22T03:13:29.551982+0000","last_became_peered":"2024-09-22T03:13:29.551982+0000","last_unstale":"2024-09-22T03:15:00.595006+0000","last_undegraded":"2024-09-22T03:15:00.595006+0000","last_fullsized":"2024-09-22T03:15:00.595006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1471,"log_dups_size":0,"ondisk_log_size":1471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"54'1680","reported_seq":1693,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:14:59.801065+0000","last_change":"2024-09-22T03:13:29.548744+0000","last_active":"2024-09-22T03:14:59.801065+0000","last_peered":"2024-09-22T03:14:59.801065+0000","last_clean":"2024-09-22T03:14:59.801065+0000","last_became_active":"2024-09-22T03:13:29.542670+0000","last_became_peered":"2024-09-22T03:13:29.542670+0000","last_unstale":"2024-09-22T03:14:59.801065+0000","last_undegraded":"2024-09-22T03:14:59.801065+0000","last_fullsized":"2024-09-22T03:14:59.801065+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1681,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"54'1439","reported_seq":1452,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:00.074398+0000","last_change":"2024-09-22T03:13:29.547139+0000","last_active":"2024-09-22T03:15:00.074398+0000","last_peered":"2024-09-22T03:15:00.074398+0000","last_clean":"2024-09-22T03:15:00.074398+0000","last_became_active":"2024-09-22T03:13:29.541888+0000","last_became_peered":"2024-09-22T03:13:29.541888+0000","last_unstale":"2024-09-22T03:15:00.074398+0000","last_undegraded":"2024-09-22T03:15:00.074398+0000","last_fullsized":"2024-09-22T03:15:00.074398+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1440,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"54'1415","reported_seq":1428,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:00.329002+0000","last_change":"2024-09-22T03:13:29.587411+0000","last_active":"2024-09-22T03:15:00.329002+0000","last_peered":"2024-09-22T03:15:00.329002+0000","last_clean":"2024-09-22T03:15:00.329002+0000","last_became_active":"2024-09-22T03:13:29.583366+0000","last_became_peered":"2024-09-22T03:13:29.583366+0000","last_unstale":"2024-09-22T03:15:00.329002+0000","last_undegraded":"2024-09-22T03:15:00.329002+0000","last_fullsized":"2024-09-22T03:15:00.329002+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1416,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'1789","reported_seq":1802,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:01.723398+0000","last_change":"2024-09-22T03:13:29.528163+0000","last_active":"2024-09-22T03:15:01.723398+0000","last_peered":"2024-09-22T03:15:01.723398+0000","last_clean":"2024-09-22T03:15:01.723398+0000","last_became_active":"2024-09-22T03:13:29.521737+0000","last_became_peered":"2024-09-22T03:13:29.521737+0000","last_unstale":"2024-09-22T03:15:01.723398+0000","last_undegraded":"2024-09-22T03:15:01.723398+0000","last_fullsized":"2024-09-22T03:15:01.723398+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1790,"num_write_kb":14272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"54'1583","reported_seq":1596,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:00.531673+0000","last_change":"2024-09-22T03:13:29.566804+0000","last_active":"2024-09-22T03:15:00.531673+0000","last_peered":"2024-09-22T03:15:00.531673+0000","last_clean":"2024-09-22T03:15:00.531673+0000","last_became_active":"2024-09-22T03:13:29.560558+0000","last_became_peered":"2024-09-22T03:13:29.560558+0000","last_unstale":"2024-09-22T03:15:00.531673+0000","last_undegraded":"2024-09-22T03:15:00.531673+0000","last_fullsized":"2024-09-22T03:15:00.531673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1583,"log_dups_size":0,"ondisk_log_size":1583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12976128,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1584,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":200097792,"num_objects":3054,"num_object_clones":0,"num_object_copies":9162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24768,"num_write_kb":197840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":298713088,"data_stored":597409840,"data_compressed":30845870,"data_compressed_allocated":298704896,"data_compressed_original":597409792,"omap_allocated":0,"internal_metadata":0},"log_size":24752,"ondisk_log_size":24752,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":163076,"kb_used_data":75700,"kb_used_omap":0,"kb_used_meta":87360,"kb_avail":94208764,"statfs":{"total":96636764160,"available":96469774336,"internally_reserved":0,"allocated":77516800,"data_stored":154259323,"data_compressed":7955867,"data_compressed_allocated":77045760,"data_compressed_original":154091520,"omap_allocated":0,"internal_metadata":89456640},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115608,"kb_used_data":56584,"kb_used_omap":0,"kb_used_meta":59008,"kb_avail":94256232,"statfs":{"total":96636764160,"available":96518381568,"internally_reserved":0,"allocated":57942016,"data_stored":115577243,"data_compressed":5958058,"data_compressed_allocated":57450496,"data_compressed_original":115392512,"omap_allocated":0,"internal_metadata":60424192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154976,"kb_used_data":86672,"kb_used_omap":0,"kb_used_meta":68288,"kb_avail":94216864,"statfs":{"total":96636764160,"available":96478068736,"internally_reserved":0,"allocated":88752128,"data_stored":177197467,"data_compressed":9139534,"data_compressed_allocated":88260608,"data_compressed_original":177012736,"omap_allocated":0,"internal_metadata":69926912},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706308,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":160372,"kb_used_data":79652,"kb_used_omap":0,"kb_used_meta":80704,"kb_avail":94211468,"statfs":{"total":96636764160,"available":96472543232,"internally_reserved":0,"allocated":81563648,"data_stored":162828680,"data_compressed":8397689,"data_compressed_allocated":81076224,"data_compressed_original":162643968,"omap_allocated":0,"internal_metadata":82640896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81207296,"data_stored":162414592,"data_compressed":8385495,"data_compressed_allocated":81207296,"data_compressed_original":162414592,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86061056,"data_stored":172113944,"data_compressed":8886868,"data_compressed_allocated":86056960,"data_compressed_original":172113920,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56135680,"data_stored":112263192,"data_compressed":5796510,"data_compressed_allocated":56131584,"data_compressed_original":112263168,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":75309056,"data_stored":150618112,"data_compressed":7776997,"data_compressed_allocated":75309056,"data_compressed_original":150618112,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:15:05.817 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:05.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:05.937+0000 7fd820997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:05.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:05.943+0000 7fd820997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:08.221 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:08.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:08.360+0000 7fdaa92fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:08.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:08.369+0000 7fdaa92fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:10.500 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:15:10.501 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:15:10.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:15:10.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:10.652+0000 7f64abf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:10.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:10.666+0000 7f64abf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:10.707 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:10.847+0000 7f24b66ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:10.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:10.858+0000 7f24b66ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:11.018 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:15:11.018 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:15:11.034 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2024-09-22T03:15:10.805580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":111166027,"num_objects":1693,"num_object_clones":0,"num_object_copies":5079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":26274,"num_write_kb":199737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26219,"ondisk_log_size":26219,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":466276,"kb_used_data":170820,"kb_used_omap":0,"kb_used_meta":295360,"kb_avail":377021084,"statfs":{"total":386547056640,"available":386069590016,"internally_reserved":0,"allocated":174919680,"data_stored":348128385,"data_compressed":17939630,"data_compressed_allocated":172965888,"data_compressed_original":347406336,"omap_allocated":0,"internal_metadata":302448640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-84123624,"num_objects":-1283,"num_object_clones":0,"num_object_copies":-3849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2368,"num_write_kb":7705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002200"},"pg_stats":[{"pgid":"8.7","version":"54'1531","reported_seq":1544,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:06.713511+0000","last_change":"2024-09-22T03:13:29.529991+0000","last_active":"2024-09-22T03:15:06.713511+0000","last_peered":"2024-09-22T03:15:06.713511+0000","last_clean":"2024-09-22T03:15:06.713511+0000","last_became_active":"2024-09-22T03:13:29.525739+0000","last_became_peered":"2024-09-22T03:13:29.525739+0000","last_unstale":"2024-09-22T03:15:06.713511+0000","last_undegraded":"2024-09-22T03:15:06.713511+0000","last_fullsized":"2024-09-22T03:15:06.713511+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1531,"log_dups_size":0,"ondisk_log_size":1531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1532,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"54'1811","reported_seq":1824,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:06.703405+0000","last_change":"2024-09-22T03:13:29.531031+0000","last_active":"2024-09-22T03:15:06.703405+0000","last_peered":"2024-09-22T03:15:06.703405+0000","last_clean":"2024-09-22T03:15:06.703405+0000","last_became_active":"2024-09-22T03:13:29.526121+0000","last_became_peered":"2024-09-22T03:13:29.526121+0000","last_unstale":"2024-09-22T03:15:06.703405+0000","last_undegraded":"2024-09-22T03:15:06.703405+0000","last_fullsized":"2024-09-22T03:15:06.703405+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1811,"log_dups_size":0,"ondisk_log_size":1811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1812,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"54'1378","reported_seq":1391,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:06.724791+0000","last_change":"2024-09-22T03:13:29.558419+0000","last_active":"2024-09-22T03:15:06.724791+0000","last_peered":"2024-09-22T03:15:06.724791+0000","last_clean":"2024-09-22T03:15:06.724791+0000","last_became_active":"2024-09-22T03:13:29.554453+0000","last_became_peered":"2024-09-22T03:13:29.554453+0000","last_unstale":"2024-09-22T03:15:06.724791+0000","last_undegraded":"2024-09-22T03:15:06.724791+0000","last_fullsized":"2024-09-22T03:15:06.724791+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1378,"log_dups_size":0,"ondisk_log_size":1378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'1675","reported_seq":1688,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:05.720290+0000","last_change":"2024-09-22T03:13:29.576486+0000","last_active":"2024-09-22T03:15:05.720290+0000","last_peered":"2024-09-22T03:15:05.720290+0000","last_clean":"2024-09-22T03:15:05.720290+0000","last_became_active":"2024-09-22T03:13:29.572229+0000","last_became_peered":"2024-09-22T03:13:29.572229+0000","last_unstale":"2024-09-22T03:15:05.720290+0000","last_undegraded":"2024-09-22T03:15:05.720290+0000","last_fullsized":"2024-09-22T03:15:05.720290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1675,"log_dups_size":0,"ondisk_log_size":1675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8273920,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1676,"num_write_kb":12816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"54'1451","reported_seq":1464,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:06.579930+0000","last_change":"2024-09-22T03:13:29.555891+0000","last_active":"2024-09-22T03:15:06.579930+0000","last_peered":"2024-09-22T03:15:06.579930+0000","last_clean":"2024-09-22T03:15:06.579930+0000","last_became_active":"2024-09-22T03:13:29.530274+0000","last_became_peered":"2024-09-22T03:13:29.530274+0000","last_unstale":"2024-09-22T03:15:06.579930+0000","last_undegraded":"2024-09-22T03:15:06.579930+0000","last_fullsized":"2024-09-22T03:15:06.579930+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1451,"log_dups_size":0,"ondisk_log_size":1451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1452,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"54'1567","reported_seq":1580,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:05.504583+0000","last_change":"2024-09-22T03:13:29.535751+0000","last_active":"2024-09-22T03:15:05.504583+0000","last_peered":"2024-09-22T03:15:05.504583+0000","last_clean":"2024-09-22T03:15:05.504583+0000","last_became_active":"2024-09-22T03:13:29.528896+0000","last_became_peered":"2024-09-22T03:13:29.528896+0000","last_unstale":"2024-09-22T03:15:05.504583+0000","last_undegraded":"2024-09-22T03:15:05.504583+0000","last_fullsized":"2024-09-22T03:15:05.504583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1567,"log_dups_size":0,"ondisk_log_size":1567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1568,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"54'1487","reported_seq":1500,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:06.750527+0000","last_change":"2024-09-22T03:13:29.533410+0000","last_active":"2024-09-22T03:15:06.750527+0000","last_peered":"2024-09-22T03:15:06.750527+0000","last_clean":"2024-09-22T03:15:06.750527+0000","last_became_active":"2024-09-22T03:13:29.524152+0000","last_became_peered":"2024-09-22T03:13:29.524152+0000","last_unstale":"2024-09-22T03:15:06.750527+0000","last_undegraded":"2024-09-22T03:15:06.750527+0000","last_fullsized":"2024-09-22T03:15:06.750527+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1488,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"54'1712","reported_seq":1725,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:06.761298+0000","last_change":"2024-09-22T03:13:29.574097+0000","last_active":"2024-09-22T03:15:06.761298+0000","last_peered":"2024-09-22T03:15:06.761298+0000","last_clean":"2024-09-22T03:15:06.761298+0000","last_became_active":"2024-09-22T03:13:29.566300+0000","last_became_peered":"2024-09-22T03:13:29.566300+0000","last_unstale":"2024-09-22T03:15:06.761298+0000","last_undegraded":"2024-09-22T03:15:06.761298+0000","last_fullsized":"2024-09-22T03:15:06.761298+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1713,"num_write_kb":12864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"54'1783","reported_seq":1796,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:05.624624+0000","last_change":"2024-09-22T03:13:29.560741+0000","last_active":"2024-09-22T03:15:05.624624+0000","last_peered":"2024-09-22T03:15:05.624624+0000","last_clean":"2024-09-22T03:15:05.624624+0000","last_became_active":"2024-09-22T03:13:29.557303+0000","last_became_peered":"2024-09-22T03:13:29.557303+0000","last_unstale":"2024-09-22T03:15:05.624624+0000","last_undegraded":"2024-09-22T03:15:05.624624+0000","last_fullsized":"2024-09-22T03:15:05.624624+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"54'1858","reported_seq":1871,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:06.682928+0000","last_change":"2024-09-22T03:13:29.549832+0000","last_active":"2024-09-22T03:15:06.682928+0000","last_peered":"2024-09-22T03:15:06.682928+0000","last_clean":"2024-09-22T03:15:06.682928+0000","last_became_active":"2024-09-22T03:13:29.525112+0000","last_became_peered":"2024-09-22T03:13:29.525112+0000","last_unstale":"2024-09-22T03:15:06.682928+0000","last_undegraded":"2024-09-22T03:15:06.682928+0000","last_fullsized":"2024-09-22T03:15:06.682928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1859,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"54'1546","reported_seq":1559,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:05.732792+0000","last_change":"2024-09-22T03:13:29.556621+0000","last_active":"2024-09-22T03:15:05.732792+0000","last_peered":"2024-09-22T03:15:05.732792+0000","last_clean":"2024-09-22T03:15:05.732792+0000","last_became_active":"2024-09-22T03:13:29.551982+0000","last_became_peered":"2024-09-22T03:13:29.551982+0000","last_unstale":"2024-09-22T03:15:05.732792+0000","last_undegraded":"2024-09-22T03:15:05.732792+0000","last_fullsized":"2024-09-22T03:15:05.732792+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1546,"log_dups_size":0,"ondisk_log_size":1546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1547,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"54'1770","reported_seq":1783,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:06.748508+0000","last_change":"2024-09-22T03:13:29.548744+0000","last_active":"2024-09-22T03:15:06.748508+0000","last_peered":"2024-09-22T03:15:06.748508+0000","last_clean":"2024-09-22T03:15:06.748508+0000","last_became_active":"2024-09-22T03:13:29.542670+0000","last_became_peered":"2024-09-22T03:13:29.542670+0000","last_unstale":"2024-09-22T03:15:06.748508+0000","last_undegraded":"2024-09-22T03:15:06.748508+0000","last_fullsized":"2024-09-22T03:15:06.748508+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1770,"log_dups_size":0,"ondisk_log_size":1770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1771,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"54'1512","reported_seq":1526,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:05.704729+0000","last_change":"2024-09-22T03:13:29.547139+0000","last_active":"2024-09-22T03:15:05.704729+0000","last_peered":"2024-09-22T03:15:05.704729+0000","last_clean":"2024-09-22T03:15:05.704729+0000","last_became_active":"2024-09-22T03:13:29.541888+0000","last_became_peered":"2024-09-22T03:13:29.541888+0000","last_unstale":"2024-09-22T03:15:05.704729+0000","last_undegraded":"2024-09-22T03:15:05.704729+0000","last_fullsized":"2024-09-22T03:15:05.704729+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1512,"log_dups_size":0,"ondisk_log_size":1512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077912,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1513,"num_write_kb":11521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"54'1490","reported_seq":1503,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:05.729906+0000","last_change":"2024-09-22T03:13:29.587411+0000","last_active":"2024-09-22T03:15:05.729906+0000","last_peered":"2024-09-22T03:15:05.729906+0000","last_clean":"2024-09-22T03:15:05.729906+0000","last_became_active":"2024-09-22T03:13:29.583366+0000","last_became_peered":"2024-09-22T03:13:29.583366+0000","last_unstale":"2024-09-22T03:15:05.729906+0000","last_undegraded":"2024-09-22T03:15:05.729906+0000","last_fullsized":"2024-09-22T03:15:05.729906+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1490,"log_dups_size":0,"ondisk_log_size":1490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1491,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'1894","reported_seq":1907,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:06.742010+0000","last_change":"2024-09-22T03:13:29.528163+0000","last_active":"2024-09-22T03:15:06.742010+0000","last_peered":"2024-09-22T03:15:06.742010+0000","last_clean":"2024-09-22T03:15:06.742010+0000","last_became_active":"2024-09-22T03:13:29.521737+0000","last_became_peered":"2024-09-22T03:13:29.521737+0000","last_unstale":"2024-09-22T03:15:06.742010+0000","last_undegraded":"2024-09-22T03:15:06.742010+0000","last_fullsized":"2024-09-22T03:15:06.742010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1894,"log_dups_size":0,"ondisk_log_size":1894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1895,"num_write_kb":14272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"54'1654","reported_seq":1667,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:15:05.501933+0000","last_change":"2024-09-22T03:13:29.566804+0000","last_active":"2024-09-22T03:15:05.501933+0000","last_peered":"2024-09-22T03:15:05.501933+0000","last_clean":"2024-09-22T03:15:05.501933+0000","last_became_active":"2024-09-22T03:13:29.560558+0000","last_became_peered":"2024-09-22T03:13:29.560558+0000","last_unstale":"2024-09-22T03:15:05.501933+0000","last_undegraded":"2024-09-22T03:15:05.501933+0000","last_fullsized":"2024-09-22T03:15:05.501933+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:13:28.445814+0000","last_clean_scrub_stamp":"2024-09-22T03:13:28.445814+0000","objects_scrubbed":0,"log_size":1654,"log_dups_size":0,"ondisk_log_size":1654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1655,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":110575640,"num_objects":1689,"num_object_clones":0,"num_object_copies":5067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":26135,"num_write_kb":197841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161550336,"data_stored":323076168,"data_compressed":16682270,"data_compressed_allocated":161538048,"data_compressed_original":323076096,"omap_allocated":0,"internal_metadata":0},"log_size":26119,"ondisk_log_size":26119,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673609,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132676,"kb_used_data":41108,"kb_used_omap":0,"kb_used_meta":91520,"kb_avail":94239164,"statfs":{"total":96636764160,"available":96500903936,"internally_reserved":0,"allocated":42094592,"data_stored":83414907,"data_compressed":4298525,"data_compressed_allocated":41623552,"data_compressed_original":83247104,"omap_allocated":0,"internal_metadata":93716480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673609,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94620,"kb_used_data":31436,"kb_used_omap":0,"kb_used_meta":63168,"kb_avail":94277220,"statfs":{"total":96636764160,"available":96539873280,"internally_reserved":0,"allocated":32190464,"data_stored":64065971,"data_compressed":3298903,"data_compressed_allocated":31694848,"data_compressed_original":63881216,"omap_allocated":0,"internal_metadata":64684032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673609,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120132,"kb_used_data":47668,"kb_used_omap":0,"kb_used_meta":72448,"kb_avail":94251708,"statfs":{"total":96636764160,"available":96513748992,"internally_reserved":0,"allocated":48812032,"data_stored":97309107,"data_compressed":5015437,"data_compressed_allocated":48316416,"data_compressed_original":97124352,"omap_allocated":0,"internal_metadata":74186752},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706313,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118848,"kb_used_data":50608,"kb_used_omap":0,"kb_used_meta":68224,"kb_avail":94252992,"statfs":{"total":96636764160,"available":96515063808,"internally_reserved":0,"allocated":51822592,"data_stored":103338400,"data_compressed":5326765,"data_compressed_allocated":51331072,"data_compressed_original":103153664,"omap_allocated":0,"internal_metadata":69861376},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":48508928,"data_stored":97009688,"data_compressed":5009165,"data_compressed_allocated":48504832,"data_compressed_original":97009664,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":44969984,"data_stored":89931800,"data_compressed":4643693,"data_compressed_allocated":44965888,"data_compressed_original":89931776,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":58720280,"data_compressed":3032063,"data_compressed_allocated":29360128,"data_compressed_original":58720256,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38707200,"data_stored":77414400,"data_compressed":3997349,"data_compressed_allocated":38707200,"data_compressed_original":77414400,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:15:12.223 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Removed 3092 objects 2024-09-22T03:15:12.223 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Clean up completed and total clean up time :10.67 2024-09-22T03:15:13.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:13.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:13.264+0000 7fece44d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:13.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:13.269+0000 7fece44d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:14.198 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_5 2024-09-22T03:15:14.198 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_5 unique_pool_5 --yes-i-really-really-mean-it 2024-09-22T03:15:14.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:14.301+0000 7ff27466c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:14.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:14.312+0000 7ff27466c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:15.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:15.457+0000 7f2337e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:15.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:15.461+0000 7f2337e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:15.465 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_5' removed 2024-09-22T03:15:15.485 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:15:15.485 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:15:15.485 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_6 2024-09-22T03:15:15.486 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_6 16 2024-09-22T03:15:15.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:15.630+0000 7f8994b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:15.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:15.641+0000 7f8994b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:16.036 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:15:16.036 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:15:16.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:15:16.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:16.135+0000 7f4375a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:16.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:16.142+0000 7f4375a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:15:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:15:16.328 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":377,"stamp":"2024-09-22T03:15:15.465142+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":341956,"kb_used_data":32516,"kb_used_omap":0,"kb_used_meta":309248,"kb_avail":377145404,"statfs":{"total":386547056640,"available":386196893696,"internally_reserved":0,"allocated":33296384,"data_stored":64881793,"data_compressed":3313986,"data_compressed_allocated":31342592,"data_compressed_original":64159744,"omap_allocated":0,"internal_metadata":316669952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-200097792,"num_objects":-3054,"num_object_clones":0,"num_object_copies":-9162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-24768,"num_write_kb":-197840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.660537"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:13:30.463996+0000","last_peered":"2024-09-22T03:13:30.463996+0000","last_clean":"2024-09-22T03:13:30.463996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:13:30.463996+0000","last_undegraded":"2024-09-22T03:13:30.463996+0000","last_fullsized":"2024-09-22T03:13:30.463996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.464459+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:13:30.464459+0000","last_peered":"2024-09-22T03:13:30.464459+0000","last_clean":"2024-09-22T03:13:30.464459+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:13:30.464459+0000","last_undegraded":"2024-09-22T03:13:30.464459+0000","last_fullsized":"2024-09-22T03:13:30.464459+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463107+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:13:30.463107+0000","last_peered":"2024-09-22T03:13:30.463107+0000","last_clean":"2024-09-22T03:13:30.463107+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:13:30.463107+0000","last_undegraded":"2024-09-22T03:13:30.463107+0000","last_fullsized":"2024-09-22T03:13:30.463107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468752+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:13:30.468752+0000","last_peered":"2024-09-22T03:13:30.468752+0000","last_clean":"2024-09-22T03:13:30.468752+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:13:30.468752+0000","last_undegraded":"2024-09-22T03:13:30.468752+0000","last_fullsized":"2024-09-22T03:13:30.468752+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468473+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:13:30.468473+0000","last_peered":"2024-09-22T03:13:30.468473+0000","last_clean":"2024-09-22T03:13:30.468473+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:13:30.468473+0000","last_undegraded":"2024-09-22T03:13:30.468473+0000","last_fullsized":"2024-09-22T03:13:30.468473+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.463551+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:13:30.463551+0000","last_peered":"2024-09-22T03:13:30.463551+0000","last_clean":"2024-09-22T03:13:30.463551+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:13:30.463551+0000","last_undegraded":"2024-09-22T03:13:30.463551+0000","last_fullsized":"2024-09-22T03:13:30.463551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466287+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:13:30.466287+0000","last_peered":"2024-09-22T03:13:30.466287+0000","last_clean":"2024-09-22T03:13:30.466287+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:13:30.466287+0000","last_undegraded":"2024-09-22T03:13:30.466287+0000","last_fullsized":"2024-09-22T03:13:30.466287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.466728+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:13:30.466728+0000","last_peered":"2024-09-22T03:13:30.466728+0000","last_clean":"2024-09-22T03:13:30.466728+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:13:30.466728+0000","last_undegraded":"2024-09-22T03:13:30.466728+0000","last_fullsized":"2024-09-22T03:13:30.466728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-22T03:13:30.468058+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:13:30.468058+0000","last_peered":"2024-09-22T03:13:30.468058+0000","last_clean":"2024-09-22T03:13:30.468058+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:13:30.468058+0000","last_undegraded":"2024-09-22T03:13:30.468058+0000","last_fullsized":"2024-09-22T03:13:30.468058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":101988,"kb_used_data":6292,"kb_used_omap":0,"kb_used_meta":95680,"kb_avail":94269852,"statfs":{"total":96636764160,"available":96532328448,"internally_reserved":0,"allocated":6443008,"data_stored":12111739,"data_compressed":616734,"data_compressed_allocated":5971968,"data_compressed_original":11943936,"omap_allocated":0,"internal_metadata":97976320},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51740,"kb_used_data":5132,"kb_used_omap":0,"kb_used_meta":46528,"kb_avail":94320100,"statfs":{"total":96636764160,"available":96583782400,"internally_reserved":0,"allocated":5255168,"data_stored":10195379,"data_compressed":517256,"data_compressed_allocated":4759552,"data_compressed_original":10010624,"omap_allocated":0,"internal_metadata":47644672},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":101956,"kb_used_data":7220,"kb_used_omap":0,"kb_used_meta":94656,"kb_avail":94269884,"statfs":{"total":96636764160,"available":96532361216,"internally_reserved":0,"allocated":7393280,"data_stored":14471603,"data_compressed":738062,"data_compressed_allocated":6897664,"data_compressed_original":14286848,"omap_allocated":0,"internal_metadata":96927744},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706318,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86272,"kb_used_data":13872,"kb_used_omap":0,"kb_used_meta":72384,"kb_avail":94285568,"statfs":{"total":96636764160,"available":96548421632,"internally_reserved":0,"allocated":14204928,"data_stored":28103072,"data_compressed":1441934,"data_compressed_allocated":13713408,"data_compressed_original":27918336,"omap_allocated":0,"internal_metadata":74121216},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:15:16.469 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_6' created 2024-09-22T03:15:16.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_6 rados --yes-i-really-mean-it || true 2024-09-22T03:15:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:16.592+0000 7f1333863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:16.604+0000 7f1333863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:17.472 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rados' on pool 'unique_pool_6' 2024-09-22T03:15:17.616 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:17.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:17.715+0000 7f1676d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:17.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:17.719+0000 7f1676d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:18.490 DEBUG:teuthology.orchestra.run.smithi134:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_6 bench 90 write' 2024-09-22T03:15:18.493 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:15:18.493 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:15:18.548 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:hints = 1 2024-09-22T03:15:18.548 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:15:18.548 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object prefix: benchmark_data_smithi134_56638 2024-09-22T03:15:18.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:15:18.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:15:19.548 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 1 16 376 360 2.81235 2.8125 0.0215474 0.0439321 2024-09-22T03:15:19.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:19.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:19.929+0000 7eff9dc2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:19.937+0000 7eff9dc2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:20.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 2 16 707 691 2.69905 2.58594 0.0306715 0.0458886 2024-09-22T03:15:21.329 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:15:21.329 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:15:21.329 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:15:21.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:21.475+0000 7fe08e42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:21.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:21.485+0000 7fe08e42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:21.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 3 16 1056 1040 2.70815 2.72656 0.0652737 0.0456116 2024-09-22T03:15:21.823 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:15:21.824 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:15:21.837 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2024-09-22T03:15:20.807380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":60,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":315524,"kb_used_data":2052,"kb_used_omap":0,"kb_used_meta":313408,"kb_avail":377171836,"statfs":{"total":386547056640,"available":386223960064,"internally_reserved":0,"allocated":2101248,"data_stored":2452080,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":320929792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.342237"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:15:16.465006+0000","last_change":"2024-09-22T03:15:16.465006+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.465006+0000","last_undegraded":"2024-09-22T03:15:16.465006+0000","last_fullsized":"2024-09-22T03:15:16.465006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-22T03:15:16.488443+0000","last_change":"2024-09-22T03:15:16.488443+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.488443+0000","last_undegraded":"2024-09-22T03:15:16.488443+0000","last_fullsized":"2024-09-22T03:15:16.488443+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-22T03:15:16.494330+0000","last_change":"2024-09-22T03:15:16.494330+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.494330+0000","last_undegraded":"2024-09-22T03:15:16.494330+0000","last_fullsized":"2024-09-22T03:15:16.494330+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-22T03:15:16.486641+0000","last_change":"2024-09-22T03:15:16.486641+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.486641+0000","last_undegraded":"2024-09-22T03:15:16.486641+0000","last_fullsized":"2024-09-22T03:15:16.486641+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-22T03:15:16.478861+0000","last_change":"2024-09-22T03:15:16.478861+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.478861+0000","last_undegraded":"2024-09-22T03:15:16.478861+0000","last_fullsized":"2024-09-22T03:15:16.478861+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-22T03:15:16.479087+0000","last_change":"2024-09-22T03:15:16.479087+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.479087+0000","last_undegraded":"2024-09-22T03:15:16.479087+0000","last_fullsized":"2024-09-22T03:15:16.479087+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:15:16.465006+0000","last_change":"2024-09-22T03:15:16.465006+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.465006+0000","last_undegraded":"2024-09-22T03:15:16.465006+0000","last_fullsized":"2024-09-22T03:15:16.465006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-22T03:15:16.478877+0000","last_change":"2024-09-22T03:15:16.478877+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.478877+0000","last_undegraded":"2024-09-22T03:15:16.478877+0000","last_fullsized":"2024-09-22T03:15:16.478877+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-22T03:15:16.487957+0000","last_change":"2024-09-22T03:15:16.487957+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.487957+0000","last_undegraded":"2024-09-22T03:15:16.487957+0000","last_fullsized":"2024-09-22T03:15:16.487957+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:15:16.474277+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:15:16.474277+0000","last_peered":"2024-09-22T03:15:16.474277+0000","last_clean":"2024-09-22T03:15:16.474277+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:15:16.474277+0000","last_undegraded":"2024-09-22T03:15:16.474277+0000","last_fullsized":"2024-09-22T03:15:16.474277+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-22T03:15:16.499268+0000","last_change":"2024-09-22T03:15:16.499268+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.499268+0000","last_undegraded":"2024-09-22T03:15:16.499268+0000","last_fullsized":"2024-09-22T03:15:16.499268+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":139,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-22T03:15:15.499343+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:15:15.499343+0000","last_peered":"2024-09-22T03:15:15.499343+0000","last_clean":"2024-09-22T03:15:15.499343+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:15:15.499343+0000","last_undegraded":"2024-09-22T03:15:15.499343+0000","last_fullsized":"2024-09-22T03:15:15.499343+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-22T03:15:16.505462+0000","last_change":"2024-09-22T03:15:16.505462+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.505462+0000","last_undegraded":"2024-09-22T03:15:16.505462+0000","last_fullsized":"2024-09-22T03:15:16.505462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":144,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:15:16.474139+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:15:16.474139+0000","last_peered":"2024-09-22T03:15:16.474139+0000","last_clean":"2024-09-22T03:15:16.474139+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:15:16.474139+0000","last_undegraded":"2024-09-22T03:15:16.474139+0000","last_fullsized":"2024-09-22T03:15:16.474139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:15:16.465006+0000","last_change":"2024-09-22T03:15:16.465006+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.465006+0000","last_undegraded":"2024-09-22T03:15:16.465006+0000","last_fullsized":"2024-09-22T03:15:16.465006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":143,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:15:16.475497+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:15:16.475497+0000","last_peered":"2024-09-22T03:15:16.475497+0000","last_clean":"2024-09-22T03:15:16.475497+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:15:16.475497+0000","last_undegraded":"2024-09-22T03:15:16.475497+0000","last_fullsized":"2024-09-22T03:15:16.475497+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":265,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-22T03:15:15.512923+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:15:15.512923+0000","last_peered":"2024-09-22T03:15:15.512923+0000","last_clean":"2024-09-22T03:15:15.512923+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:15:15.512923+0000","last_undegraded":"2024-09-22T03:15:15.512923+0000","last_fullsized":"2024-09-22T03:15:15.512923+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-22T03:15:16.497462+0000","last_change":"2024-09-22T03:15:16.497462+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.497462+0000","last_undegraded":"2024-09-22T03:15:16.497462+0000","last_fullsized":"2024-09-22T03:15:16.497462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:15:16.474633+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:15:16.474633+0000","last_peered":"2024-09-22T03:15:16.474633+0000","last_clean":"2024-09-22T03:15:16.474633+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:15:16.474633+0000","last_undegraded":"2024-09-22T03:15:16.474633+0000","last_fullsized":"2024-09-22T03:15:16.474633+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-22T03:15:16.508986+0000","last_change":"2024-09-22T03:15:16.508986+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.508986+0000","last_undegraded":"2024-09-22T03:15:16.508986+0000","last_fullsized":"2024-09-22T03:15:16.508986+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:15:16.475912+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:15:16.475912+0000","last_peered":"2024-09-22T03:15:16.475912+0000","last_clean":"2024-09-22T03:15:16.475912+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:15:16.475912+0000","last_undegraded":"2024-09-22T03:15:16.475912+0000","last_fullsized":"2024-09-22T03:15:16.475912+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:15:16.465006+0000","last_change":"2024-09-22T03:15:16.465006+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.465006+0000","last_undegraded":"2024-09-22T03:15:16.465006+0000","last_fullsized":"2024-09-22T03:15:16.465006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:15:16.475933+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:15:16.475933+0000","last_peered":"2024-09-22T03:15:16.475933+0000","last_clean":"2024-09-22T03:15:16.475933+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:15:16.475933+0000","last_undegraded":"2024-09-22T03:15:16.475933+0000","last_fullsized":"2024-09-22T03:15:16.475933+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:15:16.465006+0000","last_change":"2024-09-22T03:15:16.465006+0000","last_active":"2024-09-22T03:15:16.465006+0000","last_peered":"2024-09-22T03:15:16.465006+0000","last_clean":"2024-09-22T03:15:16.465006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:15:16.465006+0000","last_undegraded":"2024-09-22T03:15:16.465006+0000","last_fullsized":"2024-09-22T03:15:16.465006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:15:16.475472+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:15:16.475472+0000","last_peered":"2024-09-22T03:15:16.475472+0000","last_clean":"2024-09-22T03:15:16.475472+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:15:16.475472+0000","last_undegraded":"2024-09-22T03:15:16.475472+0000","last_fullsized":"2024-09-22T03:15:16.475472+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":33,"acting":33,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96168,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":95680,"kb_avail":94275672,"statfs":{"total":96636764160,"available":96538288128,"internally_reserved":0,"allocated":483328,"data_stored":171064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":97976320},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51236,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":50688,"kb_avail":94320604,"statfs":{"total":96636764160,"available":96584298496,"internally_reserved":0,"allocated":544768,"data_stored":761432,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":51904512},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95204,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":94656,"kb_avail":94276636,"statfs":{"total":96636764160,"available":96539275264,"internally_reserved":0,"allocated":544768,"data_stored":761432,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":96927744},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72916,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":72384,"kb_avail":94298924,"statfs":{"total":96636764160,"available":96562098176,"internally_reserved":0,"allocated":528384,"data_stored":758152,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":74121216},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:15:22.108 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:22.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:22.233+0000 7f6eaa86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:22.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:22.241+0000 7f6eaa86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:22.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 4 16 1377 1361 2.65802 2.50781 0.0528369 0.0467546 2024-09-22T03:15:23.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 5 16 1745 1729 2.70137 2.875 0.0532137 0.0460824 2024-09-22T03:15:24.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:24.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 6 16 2101 2085 2.71465 2.78125 0.0726667 0.0458239 2024-09-22T03:15:24.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:24.559+0000 7f0c7c957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:24.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:24.564+0000 7f0c7c957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:25.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 7 15 2425 2410 2.68954 2.53906 0.0840811 0.0463519 2024-09-22T03:15:26.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 8 16 2754 2738 2.67364 2.5625 0.0414179 0.0465888 2024-09-22T03:15:26.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:26.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:26.825+0000 7f8108b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:26.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:26.831+0000 7f8108b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:26.839 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:15:26.839 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:15:26.839 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:15:26.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:15:26.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:26.969+0000 7fd1a9597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:26.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:26.981+0000 7fd1a9597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:27.015 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:27.015 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:27.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:15:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:27.149+0000 7f8ea7e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:27.163+0000 7f8ea7e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:27.196 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:27.196 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:27.197 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:15:27.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:27.349+0000 7fa381e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:27.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:27.360+0000 7fa381e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:27.381 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:27.381 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:27.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:15:27.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:27.489+0000 7fc060b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:27.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:27.498+0000 7fc060b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:27.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 9 16 3083 3067 2.66213 2.57031 0.028557 0.0467775 2024-09-22T03:15:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:27.561 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:27.562 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:28.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 10 16 3454 3438 2.68574 2.89844 0.0438181 0.0463652 2024-09-22T03:15:29.032 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:29.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:29.174+0000 7f7eff997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:29.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:29.180+0000 7f7efe735640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:29.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 11 16 3799 3783 2.68659 2.69531 0.0597091 0.0464198 2024-09-22T03:15:30.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 12 16 4118 4102 2.67038 2.49219 0.0398337 0.0467275 2024-09-22T03:15:31.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:31.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:31.408+0000 7f36bcd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:31.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:31.414+0000 7f36bcd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:31.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 13 16 4448 4432 2.66327 2.57812 0.0941305 0.0468491 2024-09-22T03:15:32.549 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 14 16 4781 4765 2.65885 2.60156 0.0422773 0.0469128 2024-09-22T03:15:32.563 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:15:32.563 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:15:32.563 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:15:32.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:15:32.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:32.693+0000 7f42db4ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:32.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:32.703+0000 7f42db4ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:32.728 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:32.728 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:32.728 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:32.728 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:32.728 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:32.728 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:32.728 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:32.728 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:32.728 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:32.728 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:32.729 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:32.729 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:32.731 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:32.732 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:32.732 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:15:32.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:32.842+0000 7fbd6406c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:32.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:32.851+0000 7fbd6406c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:32.869 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:32.869 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:32.869 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:32.869 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:32.869 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:32.869 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:32.869 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:32.870 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:32.870 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:32.870 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:32.870 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:32.870 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:32.872 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:32.873 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:32.873 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:15:33.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:32.995+0000 7f51dc997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:33.005+0000 7f51dc997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:33.060 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:33.060 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:33.060 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:33.063 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:33.064 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:33.064 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:15:33.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:33.211+0000 7f5cef22c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:33.225+0000 7f5cef22c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:33.247 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:33.247 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:33.247 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:33.247 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:33.247 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:33.247 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:33.248 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:33.248 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:33.248 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:33.248 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:33.248 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:33.248 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:33.251 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:33.251 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:33.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 15 16 5096 5080 2.64564 2.46094 0.0772622 0.0471528 2024-09-22T03:15:33.577 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:33.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:33.700+0000 7fa55e997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:33.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:33.706+0000 7fa55e997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:34.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 16 16 5415 5399 2.63604 2.49219 0.055479 0.0473626 2024-09-22T03:15:35.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 17 16 5745 5729 2.63262 2.57812 0.0927362 0.0473692 2024-09-22T03:15:35.938 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:36.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:36.082+0000 7fe281517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:36.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:36.088+0000 7fe281517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:36.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 18 16 6067 6051 2.62611 2.51562 0.0728997 0.047483 2024-09-22T03:15:37.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 19 16 6424 6408 2.63467 2.78906 0.0221434 0.0473716 2024-09-22T03:15:38.245 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:38.252 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:15:38.252 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:15:38.252 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:15:38.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:15:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:38.381+0000 7f8b20197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:38.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:38.387+0000 7f8b20197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:38.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:38.417+0000 7fceae797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:38.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:38.427+0000 7fceae797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:38.500 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:38.500 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:38.500 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:38.500 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:38.500 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:38.501 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:38.501 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:38.501 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:38.501 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:38.501 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:38.501 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:38.501 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:38.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:38.504 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:38.504 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:15:38.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:15:38.549443+0000 min lat: 0.00992151 max lat: 0.159419 avg lat: 0.0479931 2024-09-22T03:15:38.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:15:38.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 20 16 6670 6654 2.59903 1.92188 0.0883913 0.0479931 2024-09-22T03:15:38.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:38.646+0000 7fb9db317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:38.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:38.658+0000 7fb9db317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:38.696 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:38.697 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:38.697 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:38.697 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:38.697 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:38.697 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:38.697 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:38.697 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:38.697 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:38.697 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:38.697 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:38.697 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:38.700 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:38.700 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:38.701 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:15:38.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:38.823+0000 7fc46744f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:38.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:38.833+0000 7fc46744f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:38.861 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:38.861 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:38.861 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:38.861 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:38.861 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:38.861 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:38.861 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:38.862 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:38.862 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:38.862 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:38.862 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:38.862 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:38.864 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:38.865 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:38.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:15:39.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:39.012+0000 7f5bc46d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:39.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:39.024+0000 7f5bc46d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:39.043 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:39.043 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:39.043 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:39.043 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:39.043 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:39.043 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:39.044 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:39.044 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:39.044 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:39.044 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:39.044 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:39.044 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:39.047 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:39.047 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:39.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 21 16 6980 6964 2.59058 2.42188 0.0477647 0.048183 2024-09-22T03:15:40.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 22 16 7313 7297 2.59107 2.60156 0.0385711 0.048197 2024-09-22T03:15:40.557 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:40.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:40.683+0000 7f1d56517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:40.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:40.688+0000 7f1d56517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:41.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 23 16 7631 7615 2.58642 2.48438 0.0657727 0.0482526 2024-09-22T03:15:42.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 24 16 7932 7916 2.57663 2.35156 0.0532778 0.0484523 2024-09-22T03:15:42.923 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:43.041+0000 7f6202818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:43.048+0000 7f6202818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:43.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 25 16 8255 8239 2.57449 2.52344 0.0545755 0.0485012 2024-09-22T03:15:44.048 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:15:44.048 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:15:44.048 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:15:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:44.185+0000 7fe5e4157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:44.193+0000 7fe5e4157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:44.447 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:15:44.448 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:15:44.468 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2024-09-22T03:15:42.811026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":62489139,"num_objects":949,"num_object_clones":0,"num_object_copies":2847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7695,"num_write_kb":62344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7640,"ondisk_log_size":7640,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":412232,"kb_used_data":91784,"kb_used_omap":0,"kb_used_meta":320384,"kb_avail":377075128,"statfs":{"total":386547056640,"available":386124931072,"internally_reserved":0,"allocated":93986816,"data_stored":186048677,"data_compressed":9564288,"data_compressed_allocated":91897856,"data_compressed_original":185270272,"omap_allocated":0,"internal_metadata":328073216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35078144,"num_objects":534,"num_object_clones":0,"num_object_copies":1602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4282,"num_write_kb":34256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001936"},"pg_stats":[{"pgid":"9.7","version":"58'551","reported_seq":564,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:40.731076+0000","last_change":"2024-09-22T03:15:17.603510+0000","last_active":"2024-09-22T03:15:40.731076+0000","last_peered":"2024-09-22T03:15:40.731076+0000","last_clean":"2024-09-22T03:15:40.731076+0000","last_became_active":"2024-09-22T03:15:17.598775+0000","last_became_peered":"2024-09-22T03:15:17.598775+0000","last_unstale":"2024-09-22T03:15:40.731076+0000","last_undegraded":"2024-09-22T03:15:40.731076+0000","last_fullsized":"2024-09-22T03:15:40.731076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"58'543","reported_seq":556,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:41.021847+0000","last_change":"2024-09-22T03:15:17.555497+0000","last_active":"2024-09-22T03:15:41.021847+0000","last_peered":"2024-09-22T03:15:41.021847+0000","last_clean":"2024-09-22T03:15:41.021847+0000","last_became_active":"2024-09-22T03:15:17.552730+0000","last_became_peered":"2024-09-22T03:15:17.552730+0000","last_unstale":"2024-09-22T03:15:41.021847+0000","last_undegraded":"2024-09-22T03:15:41.021847+0000","last_fullsized":"2024-09-22T03:15:41.021847+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"58'451","reported_seq":464,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:41.745764+0000","last_change":"2024-09-22T03:15:17.544468+0000","last_active":"2024-09-22T03:15:41.745764+0000","last_peered":"2024-09-22T03:15:41.745764+0000","last_clean":"2024-09-22T03:15:41.745764+0000","last_became_active":"2024-09-22T03:15:17.540930+0000","last_became_peered":"2024-09-22T03:15:17.540930+0000","last_unstale":"2024-09-22T03:15:41.745764+0000","last_undegraded":"2024-09-22T03:15:41.745764+0000","last_fullsized":"2024-09-22T03:15:41.745764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702784,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":452,"num_write_kb":3616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"58'495","reported_seq":508,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:41.746063+0000","last_change":"2024-09-22T03:15:17.551900+0000","last_active":"2024-09-22T03:15:41.746063+0000","last_peered":"2024-09-22T03:15:41.746063+0000","last_clean":"2024-09-22T03:15:41.746063+0000","last_became_active":"2024-09-22T03:15:17.548859+0000","last_became_peered":"2024-09-22T03:15:17.548859+0000","last_unstale":"2024-09-22T03:15:41.746063+0000","last_undegraded":"2024-09-22T03:15:41.746063+0000","last_fullsized":"2024-09-22T03:15:41.746063+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"58'407","reported_seq":420,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:41.536464+0000","last_change":"2024-09-22T03:15:17.559076+0000","last_active":"2024-09-22T03:15:41.536464+0000","last_peered":"2024-09-22T03:15:41.536464+0000","last_clean":"2024-09-22T03:15:41.536464+0000","last_became_active":"2024-09-22T03:15:17.551485+0000","last_became_peered":"2024-09-22T03:15:17.551485+0000","last_unstale":"2024-09-22T03:15:41.536464+0000","last_undegraded":"2024-09-22T03:15:41.536464+0000","last_fullsized":"2024-09-22T03:15:41.536464+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"58'391","reported_seq":404,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:41.697466+0000","last_change":"2024-09-22T03:15:17.552398+0000","last_active":"2024-09-22T03:15:41.697466+0000","last_peered":"2024-09-22T03:15:41.697466+0000","last_clean":"2024-09-22T03:15:41.697466+0000","last_became_active":"2024-09-22T03:15:17.548278+0000","last_became_peered":"2024-09-22T03:15:17.548278+0000","last_unstale":"2024-09-22T03:15:41.697466+0000","last_undegraded":"2024-09-22T03:15:41.697466+0000","last_fullsized":"2024-09-22T03:15:41.697466+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"58'391","reported_seq":404,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:40.110149+0000","last_change":"2024-09-22T03:15:17.613812+0000","last_active":"2024-09-22T03:15:40.110149+0000","last_peered":"2024-09-22T03:15:40.110149+0000","last_clean":"2024-09-22T03:15:40.110149+0000","last_became_active":"2024-09-22T03:15:17.608698+0000","last_became_peered":"2024-09-22T03:15:17.608698+0000","last_unstale":"2024-09-22T03:15:40.110149+0000","last_undegraded":"2024-09-22T03:15:40.110149+0000","last_fullsized":"2024-09-22T03:15:40.110149+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"58'535","reported_seq":548,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:41.503532+0000","last_change":"2024-09-22T03:15:17.560404+0000","last_active":"2024-09-22T03:15:41.503532+0000","last_peered":"2024-09-22T03:15:41.503532+0000","last_clean":"2024-09-22T03:15:41.503532+0000","last_became_active":"2024-09-22T03:15:17.553477+0000","last_became_peered":"2024-09-22T03:15:17.553477+0000","last_unstale":"2024-09-22T03:15:41.503532+0000","last_undegraded":"2024-09-22T03:15:41.503532+0000","last_fullsized":"2024-09-22T03:15:41.503532+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"58'535","reported_seq":548,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:41.524215+0000","last_change":"2024-09-22T03:15:17.580165+0000","last_active":"2024-09-22T03:15:41.524215+0000","last_peered":"2024-09-22T03:15:41.524215+0000","last_clean":"2024-09-22T03:15:41.524215+0000","last_became_active":"2024-09-22T03:15:17.575370+0000","last_became_peered":"2024-09-22T03:15:17.575370+0000","last_unstale":"2024-09-22T03:15:41.524215+0000","last_undegraded":"2024-09-22T03:15:41.524215+0000","last_fullsized":"2024-09-22T03:15:41.524215+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481002+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:15:18.481002+0000","last_peered":"2024-09-22T03:15:18.481002+0000","last_clean":"2024-09-22T03:15:18.481002+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:15:18.481002+0000","last_undegraded":"2024-09-22T03:15:18.481002+0000","last_fullsized":"2024-09-22T03:15:18.481002+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"58'399","reported_seq":412,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:41.377233+0000","last_change":"2024-09-22T03:15:17.555536+0000","last_active":"2024-09-22T03:15:41.377233+0000","last_peered":"2024-09-22T03:15:41.377233+0000","last_clean":"2024-09-22T03:15:41.377233+0000","last_became_active":"2024-09-22T03:15:17.549158+0000","last_became_peered":"2024-09-22T03:15:17.549158+0000","last_unstale":"2024-09-22T03:15:41.377233+0000","last_undegraded":"2024-09-22T03:15:41.377233+0000","last_fullsized":"2024-09-22T03:15:41.377233+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482214+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:15:18.482214+0000","last_peered":"2024-09-22T03:15:18.482214+0000","last_clean":"2024-09-22T03:15:18.482214+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:15:18.482214+0000","last_undegraded":"2024-09-22T03:15:18.482214+0000","last_fullsized":"2024-09-22T03:15:18.482214+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"58'391","reported_seq":404,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:39.753600+0000","last_change":"2024-09-22T03:15:17.558546+0000","last_active":"2024-09-22T03:15:39.753600+0000","last_peered":"2024-09-22T03:15:39.753600+0000","last_clean":"2024-09-22T03:15:39.753600+0000","last_became_active":"2024-09-22T03:15:17.551021+0000","last_became_peered":"2024-09-22T03:15:17.551021+0000","last_unstale":"2024-09-22T03:15:39.753600+0000","last_undegraded":"2024-09-22T03:15:39.753600+0000","last_fullsized":"2024-09-22T03:15:39.753600+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":150,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.478594+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:15:18.478594+0000","last_peered":"2024-09-22T03:15:18.478594+0000","last_clean":"2024-09-22T03:15:18.478594+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:15:18.478594+0000","last_undegraded":"2024-09-22T03:15:18.478594+0000","last_fullsized":"2024-09-22T03:15:18.478594+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"58'487","reported_seq":500,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:39.685158+0000","last_change":"2024-09-22T03:15:17.587320+0000","last_active":"2024-09-22T03:15:39.685158+0000","last_peered":"2024-09-22T03:15:39.685158+0000","last_clean":"2024-09-22T03:15:39.685158+0000","last_became_active":"2024-09-22T03:15:17.583134+0000","last_became_peered":"2024-09-22T03:15:17.583134+0000","last_unstale":"2024-09-22T03:15:39.685158+0000","last_undegraded":"2024-09-22T03:15:39.685158+0000","last_fullsized":"2024-09-22T03:15:39.685158+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":149,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482514+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:15:18.482514+0000","last_peered":"2024-09-22T03:15:18.482514+0000","last_clean":"2024-09-22T03:15:18.482514+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:15:18.482514+0000","last_undegraded":"2024-09-22T03:15:18.482514+0000","last_fullsized":"2024-09-22T03:15:18.482514+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":274,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484533+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:15:18.484533+0000","last_peered":"2024-09-22T03:15:18.484533+0000","last_clean":"2024-09-22T03:15:18.484533+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:15:18.484533+0000","last_undegraded":"2024-09-22T03:15:18.484533+0000","last_fullsized":"2024-09-22T03:15:18.484533+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"58'455","reported_seq":468,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:40.988402+0000","last_change":"2024-09-22T03:15:17.537196+0000","last_active":"2024-09-22T03:15:40.988402+0000","last_peered":"2024-09-22T03:15:40.988402+0000","last_clean":"2024-09-22T03:15:40.988402+0000","last_became_active":"2024-09-22T03:15:17.533477+0000","last_became_peered":"2024-09-22T03:15:17.533477+0000","last_unstale":"2024-09-22T03:15:40.988402+0000","last_undegraded":"2024-09-22T03:15:40.988402+0000","last_fullsized":"2024-09-22T03:15:40.988402+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.479925+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:15:18.479925+0000","last_peered":"2024-09-22T03:15:18.479925+0000","last_clean":"2024-09-22T03:15:18.479925+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:15:18.479925+0000","last_undegraded":"2024-09-22T03:15:18.479925+0000","last_fullsized":"2024-09-22T03:15:18.479925+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"58'519","reported_seq":532,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:41.785045+0000","last_change":"2024-09-22T03:15:17.566685+0000","last_active":"2024-09-22T03:15:41.785045+0000","last_peered":"2024-09-22T03:15:41.785045+0000","last_clean":"2024-09-22T03:15:41.785045+0000","last_became_active":"2024-09-22T03:15:17.563064+0000","last_became_peered":"2024-09-22T03:15:17.563064+0000","last_unstale":"2024-09-22T03:15:41.785045+0000","last_undegraded":"2024-09-22T03:15:41.785045+0000","last_fullsized":"2024-09-22T03:15:41.785045+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484209+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:15:18.484209+0000","last_peered":"2024-09-22T03:15:18.484209+0000","last_clean":"2024-09-22T03:15:18.484209+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:15:18.484209+0000","last_undegraded":"2024-09-22T03:15:18.484209+0000","last_fullsized":"2024-09-22T03:15:18.484209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"58'455","reported_seq":468,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:40.772177+0000","last_change":"2024-09-22T03:15:17.580838+0000","last_active":"2024-09-22T03:15:40.772177+0000","last_peered":"2024-09-22T03:15:40.772177+0000","last_clean":"2024-09-22T03:15:40.772177+0000","last_became_active":"2024-09-22T03:15:17.576369+0000","last_became_peered":"2024-09-22T03:15:17.576369+0000","last_unstale":"2024-09-22T03:15:40.772177+0000","last_undegraded":"2024-09-22T03:15:40.772177+0000","last_fullsized":"2024-09-22T03:15:40.772177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484810+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:15:18.484810+0000","last_peered":"2024-09-22T03:15:18.484810+0000","last_clean":"2024-09-22T03:15:18.484810+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:15:18.484810+0000","last_undegraded":"2024-09-22T03:15:18.484810+0000","last_fullsized":"2024-09-22T03:15:18.484810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"58'535","reported_seq":548,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:40.688973+0000","last_change":"2024-09-22T03:15:17.578659+0000","last_active":"2024-09-22T03:15:40.688973+0000","last_peered":"2024-09-22T03:15:40.688973+0000","last_clean":"2024-09-22T03:15:40.688973+0000","last_became_active":"2024-09-22T03:15:17.572652+0000","last_became_peered":"2024-09-22T03:15:17.572652+0000","last_unstale":"2024-09-22T03:15:40.688973+0000","last_undegraded":"2024-09-22T03:15:40.688973+0000","last_fullsized":"2024-09-22T03:15:40.688973+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481987+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:15:18.481987+0000","last_peered":"2024-09-22T03:15:18.481987+0000","last_clean":"2024-09-22T03:15:18.481987+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:15:18.481987+0000","last_undegraded":"2024-09-22T03:15:18.481987+0000","last_fullsized":"2024-09-22T03:15:18.481987+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":61898752,"num_objects":945,"num_object_clones":0,"num_object_copies":2835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7556,"num_write_kb":60448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":93093888,"data_stored":186187776,"data_compressed":9610614,"data_compressed_allocated":93093888,"data_compressed_original":186187776,"omap_allocated":0,"internal_metadata":0},"log_size":7540,"ondisk_log_size":7540,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112560,"kb_used_data":25184,"kb_used_omap":0,"kb_used_meta":87360,"kb_avail":94259280,"statfs":{"total":96636764160,"available":96521502720,"internally_reserved":0,"allocated":25788416,"data_stored":50742934,"data_compressed":2609774,"data_compressed_allocated":25280512,"data_compressed_original":50561024,"omap_allocated":0,"internal_metadata":89456640},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87612,"kb_used_data":18860,"kb_used_omap":0,"kb_used_meta":68736,"kb_avail":94284228,"statfs":{"total":96636764160,"available":96547049472,"internally_reserved":0,"allocated":19312640,"data_stored":38258870,"data_compressed":1965026,"data_compressed_allocated":18784256,"data_compressed_original":38060032,"omap_allocated":0,"internal_metadata":70385664},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":102516,"kb_used_data":20324,"kb_used_omap":0,"kb_used_meta":82176,"kb_avail":94269324,"statfs":{"total":96636764160,"available":96531787776,"internally_reserved":0,"allocated":20811776,"data_stored":41257142,"data_compressed":2119646,"data_compressed_allocated":20283392,"data_compressed_original":41058304,"omap_allocated":0,"internal_metadata":84148224},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706348,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":109544,"kb_used_data":27416,"kb_used_omap":0,"kb_used_meta":82112,"kb_avail":94262296,"statfs":{"total":96636764160,"available":96524591104,"internally_reserved":0,"allocated":28073984,"data_stored":55789731,"data_compressed":2869842,"data_compressed_allocated":27549696,"data_compressed_original":55590912,"omap_allocated":0,"internal_metadata":84082688},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":56008704,"data_compressed":2891065,"data_compressed_allocated":28004352,"data_compressed_original":56008704,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20512768,"data_stored":41025536,"data_compressed":2117604,"data_compressed_allocated":20512768,"data_compressed_original":41025536,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18956288,"data_stored":37912576,"data_compressed":1957062,"data_compressed_allocated":18956288,"data_compressed_original":37912576,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25620480,"data_stored":51240960,"data_compressed":2644883,"data_compressed_allocated":25620480,"data_compressed_original":51240960,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:15:44.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 26 16 8577 8561 2.57222 2.51562 0.0551917 0.0485379 2024-09-22T03:15:45.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:45.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:45.394+0000 7fa218797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:45.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:45.401+0000 7fa218797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:45.550 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 27 16 8892 8876 2.56809 2.46094 0.0265831 0.0486206 2024-09-22T03:15:46.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 28 16 9186 9170 2.5584 2.29688 0.0332096 0.0488033 2024-09-22T03:15:47.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 29 16 9457 9441 2.54318 2.11719 0.0391649 0.0491119 2024-09-22T03:15:47.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:47.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:47.737+0000 7f8affb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:47.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:47.746+0000 7f8affb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:48.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 30 16 9751 9735 2.53496 2.29688 0.0665404 0.0492387 2024-09-22T03:15:49.470 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:15:49.470 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:15:49.471 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:15:49.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 31 16 10076 10060 2.53509 2.53906 0.0451408 0.049256 2024-09-22T03:15:49.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:49.584+0000 7f9e31957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:49.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:49.593+0000 7f9e31957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:49.890 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:15:49.943 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:15:49.959 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":397,"stamp":"2024-09-22T03:15:48.812156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75948595,"num_objects":1154,"num_object_clones":0,"num_object_copies":3462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":9338,"num_write_kb":75488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9283,"ondisk_log_size":9283,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":451828,"kb_used_data":110580,"kb_used_omap":0,"kb_used_meta":341184,"kb_avail":377035532,"statfs":{"total":386547056640,"available":386084384768,"internally_reserved":0,"allocated":113233920,"data_stored":224542885,"data_compressed":11551965,"data_compressed_allocated":111144960,"data_compressed_original":223764480,"omap_allocated":0,"internal_metadata":349372416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26140672,"num_objects":399,"num_object_clones":0,"num_object_copies":1197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3191,"num_write_kb":25528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002117"},"pg_stats":[{"pgid":"9.7","version":"58'663","reported_seq":676,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:45.395273+0000","last_change":"2024-09-22T03:15:17.603510+0000","last_active":"2024-09-22T03:15:45.395273+0000","last_peered":"2024-09-22T03:15:45.395273+0000","last_clean":"2024-09-22T03:15:45.395273+0000","last_became_active":"2024-09-22T03:15:17.598775+0000","last_became_peered":"2024-09-22T03:15:17.598775+0000","last_unstale":"2024-09-22T03:15:45.395273+0000","last_undegraded":"2024-09-22T03:15:45.395273+0000","last_fullsized":"2024-09-22T03:15:45.395273+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"58'639","reported_seq":652,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:46.650979+0000","last_change":"2024-09-22T03:15:17.555497+0000","last_active":"2024-09-22T03:15:46.650979+0000","last_peered":"2024-09-22T03:15:46.650979+0000","last_clean":"2024-09-22T03:15:46.650979+0000","last_became_active":"2024-09-22T03:15:17.552730+0000","last_became_peered":"2024-09-22T03:15:17.552730+0000","last_unstale":"2024-09-22T03:15:46.650979+0000","last_undegraded":"2024-09-22T03:15:46.650979+0000","last_fullsized":"2024-09-22T03:15:46.650979+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"58'591","reported_seq":604,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:46.624728+0000","last_change":"2024-09-22T03:15:17.544468+0000","last_active":"2024-09-22T03:15:46.624728+0000","last_peered":"2024-09-22T03:15:46.624728+0000","last_clean":"2024-09-22T03:15:46.624728+0000","last_became_active":"2024-09-22T03:15:17.540930+0000","last_became_peered":"2024-09-22T03:15:17.540930+0000","last_unstale":"2024-09-22T03:15:46.624728+0000","last_undegraded":"2024-09-22T03:15:46.624728+0000","last_fullsized":"2024-09-22T03:15:46.624728+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"58'599","reported_seq":612,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:45.740529+0000","last_change":"2024-09-22T03:15:17.551900+0000","last_active":"2024-09-22T03:15:45.740529+0000","last_peered":"2024-09-22T03:15:45.740529+0000","last_clean":"2024-09-22T03:15:45.740529+0000","last_became_active":"2024-09-22T03:15:17.548859+0000","last_became_peered":"2024-09-22T03:15:17.548859+0000","last_unstale":"2024-09-22T03:15:45.740529+0000","last_undegraded":"2024-09-22T03:15:45.740529+0000","last_fullsized":"2024-09-22T03:15:45.740529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"58'503","reported_seq":516,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:46.267486+0000","last_change":"2024-09-22T03:15:17.559076+0000","last_active":"2024-09-22T03:15:46.267486+0000","last_peered":"2024-09-22T03:15:46.267486+0000","last_clean":"2024-09-22T03:15:46.267486+0000","last_became_active":"2024-09-22T03:15:17.551485+0000","last_became_peered":"2024-09-22T03:15:17.551485+0000","last_unstale":"2024-09-22T03:15:46.267486+0000","last_undegraded":"2024-09-22T03:15:46.267486+0000","last_fullsized":"2024-09-22T03:15:46.267486+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"58'471","reported_seq":484,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:46.035751+0000","last_change":"2024-09-22T03:15:17.552398+0000","last_active":"2024-09-22T03:15:46.035751+0000","last_peered":"2024-09-22T03:15:46.035751+0000","last_clean":"2024-09-22T03:15:46.035751+0000","last_became_active":"2024-09-22T03:15:17.548278+0000","last_became_peered":"2024-09-22T03:15:17.548278+0000","last_unstale":"2024-09-22T03:15:46.035751+0000","last_undegraded":"2024-09-22T03:15:46.035751+0000","last_fullsized":"2024-09-22T03:15:46.035751+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"58'455","reported_seq":468,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:45.618761+0000","last_change":"2024-09-22T03:15:17.613812+0000","last_active":"2024-09-22T03:15:45.618761+0000","last_peered":"2024-09-22T03:15:45.618761+0000","last_clean":"2024-09-22T03:15:45.618761+0000","last_became_active":"2024-09-22T03:15:17.608698+0000","last_became_peered":"2024-09-22T03:15:17.608698+0000","last_unstale":"2024-09-22T03:15:45.618761+0000","last_undegraded":"2024-09-22T03:15:45.618761+0000","last_fullsized":"2024-09-22T03:15:45.618761+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"58'663","reported_seq":676,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:46.398759+0000","last_change":"2024-09-22T03:15:17.560404+0000","last_active":"2024-09-22T03:15:46.398759+0000","last_peered":"2024-09-22T03:15:46.398759+0000","last_clean":"2024-09-22T03:15:46.398759+0000","last_became_active":"2024-09-22T03:15:17.553477+0000","last_became_peered":"2024-09-22T03:15:17.553477+0000","last_unstale":"2024-09-22T03:15:46.398759+0000","last_undegraded":"2024-09-22T03:15:46.398759+0000","last_fullsized":"2024-09-22T03:15:46.398759+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"58'623","reported_seq":636,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:46.737924+0000","last_change":"2024-09-22T03:15:17.580165+0000","last_active":"2024-09-22T03:15:46.737924+0000","last_peered":"2024-09-22T03:15:46.737924+0000","last_clean":"2024-09-22T03:15:46.737924+0000","last_became_active":"2024-09-22T03:15:17.575370+0000","last_became_peered":"2024-09-22T03:15:17.575370+0000","last_unstale":"2024-09-22T03:15:46.737924+0000","last_undegraded":"2024-09-22T03:15:46.737924+0000","last_fullsized":"2024-09-22T03:15:46.737924+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481002+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:15:18.481002+0000","last_peered":"2024-09-22T03:15:18.481002+0000","last_clean":"2024-09-22T03:15:18.481002+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:15:18.481002+0000","last_undegraded":"2024-09-22T03:15:18.481002+0000","last_fullsized":"2024-09-22T03:15:18.481002+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"58'503","reported_seq":516,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:46.461404+0000","last_change":"2024-09-22T03:15:17.555536+0000","last_active":"2024-09-22T03:15:46.461404+0000","last_peered":"2024-09-22T03:15:46.461404+0000","last_clean":"2024-09-22T03:15:46.461404+0000","last_became_active":"2024-09-22T03:15:17.549158+0000","last_became_peered":"2024-09-22T03:15:17.549158+0000","last_unstale":"2024-09-22T03:15:46.461404+0000","last_undegraded":"2024-09-22T03:15:46.461404+0000","last_fullsized":"2024-09-22T03:15:46.461404+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482214+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:15:18.482214+0000","last_peered":"2024-09-22T03:15:18.482214+0000","last_clean":"2024-09-22T03:15:18.482214+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:15:18.482214+0000","last_undegraded":"2024-09-22T03:15:18.482214+0000","last_fullsized":"2024-09-22T03:15:18.482214+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"58'511","reported_seq":524,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:46.583907+0000","last_change":"2024-09-22T03:15:17.558546+0000","last_active":"2024-09-22T03:15:46.583907+0000","last_peered":"2024-09-22T03:15:46.583907+0000","last_clean":"2024-09-22T03:15:46.583907+0000","last_became_active":"2024-09-22T03:15:17.551021+0000","last_became_peered":"2024-09-22T03:15:17.551021+0000","last_unstale":"2024-09-22T03:15:46.583907+0000","last_undegraded":"2024-09-22T03:15:46.583907+0000","last_fullsized":"2024-09-22T03:15:46.583907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":150,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.478594+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:15:18.478594+0000","last_peered":"2024-09-22T03:15:18.478594+0000","last_clean":"2024-09-22T03:15:18.478594+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:15:18.478594+0000","last_undegraded":"2024-09-22T03:15:18.478594+0000","last_fullsized":"2024-09-22T03:15:18.478594+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"58'567","reported_seq":580,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:45.602773+0000","last_change":"2024-09-22T03:15:17.587320+0000","last_active":"2024-09-22T03:15:45.602773+0000","last_peered":"2024-09-22T03:15:45.602773+0000","last_clean":"2024-09-22T03:15:45.602773+0000","last_became_active":"2024-09-22T03:15:17.583134+0000","last_became_peered":"2024-09-22T03:15:17.583134+0000","last_unstale":"2024-09-22T03:15:45.602773+0000","last_undegraded":"2024-09-22T03:15:45.602773+0000","last_fullsized":"2024-09-22T03:15:45.602773+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":149,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482514+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:15:18.482514+0000","last_peered":"2024-09-22T03:15:18.482514+0000","last_clean":"2024-09-22T03:15:18.482514+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:15:18.482514+0000","last_undegraded":"2024-09-22T03:15:18.482514+0000","last_fullsized":"2024-09-22T03:15:18.482514+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":274,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484533+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:15:18.484533+0000","last_peered":"2024-09-22T03:15:18.484533+0000","last_clean":"2024-09-22T03:15:18.484533+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:15:18.484533+0000","last_undegraded":"2024-09-22T03:15:18.484533+0000","last_fullsized":"2024-09-22T03:15:18.484533+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"58'550","reported_seq":563,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:46.773558+0000","last_change":"2024-09-22T03:15:17.537196+0000","last_active":"2024-09-22T03:15:46.773558+0000","last_peered":"2024-09-22T03:15:46.773558+0000","last_clean":"2024-09-22T03:15:46.773558+0000","last_became_active":"2024-09-22T03:15:17.533477+0000","last_became_peered":"2024-09-22T03:15:17.533477+0000","last_unstale":"2024-09-22T03:15:46.773558+0000","last_undegraded":"2024-09-22T03:15:46.773558+0000","last_fullsized":"2024-09-22T03:15:46.773558+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4513792,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":551,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.479925+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:15:18.479925+0000","last_peered":"2024-09-22T03:15:18.479925+0000","last_clean":"2024-09-22T03:15:18.479925+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:15:18.479925+0000","last_undegraded":"2024-09-22T03:15:18.479925+0000","last_fullsized":"2024-09-22T03:15:18.479925+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"58'631","reported_seq":644,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:46.505192+0000","last_change":"2024-09-22T03:15:17.566685+0000","last_active":"2024-09-22T03:15:46.505192+0000","last_peered":"2024-09-22T03:15:46.505192+0000","last_clean":"2024-09-22T03:15:46.505192+0000","last_became_active":"2024-09-22T03:15:17.563064+0000","last_became_peered":"2024-09-22T03:15:17.563064+0000","last_unstale":"2024-09-22T03:15:46.505192+0000","last_undegraded":"2024-09-22T03:15:46.505192+0000","last_fullsized":"2024-09-22T03:15:46.505192+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484209+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:15:18.484209+0000","last_peered":"2024-09-22T03:15:18.484209+0000","last_clean":"2024-09-22T03:15:18.484209+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:15:18.484209+0000","last_undegraded":"2024-09-22T03:15:18.484209+0000","last_fullsized":"2024-09-22T03:15:18.484209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"58'583","reported_seq":596,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:45.556625+0000","last_change":"2024-09-22T03:15:17.580838+0000","last_active":"2024-09-22T03:15:45.556625+0000","last_peered":"2024-09-22T03:15:45.556625+0000","last_clean":"2024-09-22T03:15:45.556625+0000","last_became_active":"2024-09-22T03:15:17.576369+0000","last_became_peered":"2024-09-22T03:15:17.576369+0000","last_unstale":"2024-09-22T03:15:45.556625+0000","last_undegraded":"2024-09-22T03:15:45.556625+0000","last_fullsized":"2024-09-22T03:15:45.556625+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484810+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:15:18.484810+0000","last_peered":"2024-09-22T03:15:18.484810+0000","last_clean":"2024-09-22T03:15:18.484810+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:15:18.484810+0000","last_undegraded":"2024-09-22T03:15:18.484810+0000","last_fullsized":"2024-09-22T03:15:18.484810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"58'631","reported_seq":644,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:45.314009+0000","last_change":"2024-09-22T03:15:17.578659+0000","last_active":"2024-09-22T03:15:45.314009+0000","last_peered":"2024-09-22T03:15:45.314009+0000","last_clean":"2024-09-22T03:15:45.314009+0000","last_became_active":"2024-09-22T03:15:17.572652+0000","last_became_peered":"2024-09-22T03:15:17.572652+0000","last_unstale":"2024-09-22T03:15:45.314009+0000","last_undegraded":"2024-09-22T03:15:45.314009+0000","last_fullsized":"2024-09-22T03:15:45.314009+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481987+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:15:18.481987+0000","last_peered":"2024-09-22T03:15:18.481987+0000","last_clean":"2024-09-22T03:15:18.481987+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:15:18.481987+0000","last_undegraded":"2024-09-22T03:15:18.481987+0000","last_fullsized":"2024-09-22T03:15:18.481987+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":75358208,"num_objects":1150,"num_object_clones":0,"num_object_copies":3450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9199,"num_write_kb":73592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":112431104,"data_stored":224862208,"data_compressed":11607597,"data_compressed_allocated":112431104,"data_compressed_original":224862208,"omap_allocated":0,"internal_metadata":0},"log_size":9183,"ondisk_log_size":9183,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121704,"kb_used_data":30168,"kb_used_omap":0,"kb_used_meta":91520,"kb_avail":94250136,"statfs":{"total":96636764160,"available":96512139264,"internally_reserved":0,"allocated":30892032,"data_stored":60950166,"data_compressed":3136832,"data_compressed_allocated":30384128,"data_compressed_original":60768256,"omap_allocated":0,"internal_metadata":93716480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96064,"kb_used_data":23152,"kb_used_omap":0,"kb_used_meta":72896,"kb_avail":94275776,"statfs":{"total":96636764160,"available":96538394624,"internally_reserved":0,"allocated":23707648,"data_stored":47048886,"data_compressed":2418905,"data_compressed_allocated":23179264,"data_compressed_original":46850048,"omap_allocated":0,"internal_metadata":74645504},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110240,"kb_used_data":23888,"kb_used_omap":0,"kb_used_meta":86336,"kb_avail":94261600,"statfs":{"total":96636764160,"available":96523878400,"internally_reserved":0,"allocated":24461312,"data_stored":48556214,"data_compressed":2496539,"data_compressed_allocated":23932928,"data_compressed_original":48357376,"omap_allocated":0,"internal_metadata":88408064},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706353,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123820,"kb_used_data":33372,"kb_used_omap":0,"kb_used_meta":90432,"kb_avail":94248020,"statfs":{"total":96636764160,"available":96509972480,"internally_reserved":0,"allocated":34172928,"data_stored":67987619,"data_compressed":3499689,"data_compressed_allocated":33648640,"data_compressed_original":67788800,"omap_allocated":0,"internal_metadata":92602368},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34115584,"data_stored":68231168,"data_compressed":3522181,"data_compressed_allocated":34115584,"data_compressed_original":68231168,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24145920,"data_stored":48291840,"data_compressed":2492805,"data_compressed_allocated":24145920,"data_compressed_original":48291840,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23363584,"data_stored":46727168,"data_compressed":2412210,"data_compressed_allocated":23363584,"data_compressed_original":46727168,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30806016,"data_stored":61612032,"data_compressed":3180401,"data_compressed_allocated":30806016,"data_compressed_original":61612032,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:15:50.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:50.022+0000 7f62fded7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:50.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:50.027+0000 7f62fded7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:50.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 32 16 10359 10343 2.52495 2.21094 0.0641714 0.0494499 2024-09-22T03:15:51.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 33 16 10663 10647 2.5204 2.375 0.0595791 0.0495442 2024-09-22T03:15:52.248 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:52.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:52.361+0000 7f89a7ab2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:52.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:52.366+0000 7f89a7ab2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:52.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 34 16 10968 10952 2.51635 2.38281 0.0323456 0.0496471 2024-09-22T03:15:53.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 35 16 11232 11216 2.50338 2.0625 0.062439 0.0498455 2024-09-22T03:15:54.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:54.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 36 16 11536 11520 2.49981 2.375 0.0410761 0.0499685 2024-09-22T03:15:54.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:54.684+0000 7f7110d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:54.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:54.690+0000 7f7110d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:54.961 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:15:54.961 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:15:54.961 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:15:54.962 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:15:55.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:55.086+0000 7fbd8c4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:55.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:55.094+0000 7fbd8c4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:55.123 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:55.123 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:55.124 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:55.124 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:55.124 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:55.124 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:55.124 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:55.124 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:55.124 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:55.124 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:55.124 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:55.124 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:55.127 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:55.128 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:55.128 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:15:55.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:55.253+0000 7f27c5ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:55.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:55.262+0000 7f27c5ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:55.279 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:55.279 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:55.279 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:55.279 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:55.279 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:55.279 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:55.279 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:55.279 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:55.279 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:55.279 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:55.279 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:55.280 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:55.283 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:55.284 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:55.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:15:55.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:55.412+0000 7f6ea1d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:55.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:55.421+0000 7f6ea1d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:55.437 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:55.437 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:55.437 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:55.441 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:55.442 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:55.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:15:55.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 37 16 11810 11794 2.4901 2.14062 0.0286518 0.050156 2024-09-22T03:15:55.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:55.602+0000 7ff5fb997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:55.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:55.613+0000 7ff5fb997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:55.652 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:15:55.652 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:15:55.652 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:15:55.652 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:15:55.652 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:15:55.652 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:15:55.652 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:15:55.652 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:15:55.653 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:15:55.653 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:15:55.653 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:15:55.653 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:15:55.655 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:15:55.655 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:15:56.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 38 16 12117 12101 2.48768 2.39844 0.0441675 0.0502088 2024-09-22T03:15:56.872 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:15:57.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:57.015+0000 7fd548397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:57.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:57.021+0000 7fd548397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:57.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 39 16 12414 12398 2.48338 2.32031 0.0877889 0.0502849 2024-09-22T03:15:58.551 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:15:58.551029+0000 min lat: 0.00992151 max lat: 0.159419 avg lat: 0.0504314 2024-09-22T03:15:58.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:15:58.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 40 16 12695 12679 2.47618 2.19531 0.0868616 0.0504314 2024-09-22T03:15:59.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:15:59.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:59.236+0000 7fd916597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:59.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:15:59.244+0000 7fd916597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:15:59.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 41 16 12968 12952 2.4678 2.13281 0.075767 0.0506038 2024-09-22T03:16:00.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 42 16 13263 13247 2.46391 2.30469 0.0401876 0.0506999 2024-09-22T03:16:00.656 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:16:00.656 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:16:00.656 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:16:00.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:16:00.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:00.814+0000 7f1509157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:00.826+0000 7f1509157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:00.937 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:00.937 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:00.938 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:00.938 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:00.938 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:00.938 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:00.938 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:00.938 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:00.938 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:00.938 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:00.938 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:00.939 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:00.941 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:00.942 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:00.942 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:16:01.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:01.053+0000 7fbb73818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:01.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:01.064+0000 7fbb73818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:01.082 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:01.082 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:01.084 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:01.085 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:01.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:16:01.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:01.233+0000 7f761744f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:01.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:01.242+0000 7f761744f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:01.260 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:01.263 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:01.263 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:01.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:16:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:01.389+0000 7f92ad418640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:01.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:01.403+0000 7f92ad418640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:01.495 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:01.498 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:01.499 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:01.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:01.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 43 16 13546 13530 2.45802 2.21094 0.0230575 0.0508241 2024-09-22T03:16:01.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:01.667+0000 7f079d517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:01.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:01.674+0000 7f079d517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:02.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 44 16 13806 13790 2.44832 2.03125 0.0621349 0.0510098 2024-09-22T03:16:03.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 45 16 14110 14094 2.44669 2.375 0.0477015 0.0510436 2024-09-22T03:16:03.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:04.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:04.034+0000 7f7a30157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:04.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:04.040+0000 7f7a30157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:04.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 46 16 14389 14373 2.44088 2.17969 0.0516352 0.0511748 2024-09-22T03:16:05.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 47 16 14658 14642 2.43365 2.10156 0.0621182 0.0513203 2024-09-22T03:16:06.329 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:06.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:06.451+0000 7f74a0b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:06.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:06.458+0000 7f74a0b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:06.500 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:16:06.500 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:16:06.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:16:06.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 48 16 14932 14916 2.42755 2.14062 0.0415659 0.0514525 2024-09-22T03:16:06.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:06.642+0000 7f4e8c218640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:06.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:06.651+0000 7f4e8c218640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:16:06.864 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:16:06.878 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-22T03:16:06.815387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":122536499,"num_objects":1865,"num_object_clones":0,"num_object_copies":5595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":15025,"num_write_kb":120984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14970,"ondisk_log_size":14970,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":539008,"kb_used_data":179712,"kb_used_omap":0,"kb_used_meta":359232,"kb_avail":376948352,"statfs":{"total":386547056640,"available":385995112448,"internally_reserved":0,"allocated":184025088,"data_stored":366125221,"data_compressed":18862671,"data_compressed_allocated":181936128,"data_compressed_original":365346816,"omap_allocated":0,"internal_metadata":367853568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34824192,"num_objects":531,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4251,"num_write_kb":34008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002215"},"pg_stats":[{"pgid":"9.7","version":"58'1013","reported_seq":1026,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.774123+0000","last_change":"2024-09-22T03:15:17.603510+0000","last_active":"2024-09-22T03:16:05.774123+0000","last_peered":"2024-09-22T03:16:05.774123+0000","last_clean":"2024-09-22T03:16:05.774123+0000","last_became_active":"2024-09-22T03:15:17.598775+0000","last_became_peered":"2024-09-22T03:15:17.598775+0000","last_unstale":"2024-09-22T03:16:05.774123+0000","last_undegraded":"2024-09-22T03:16:05.774123+0000","last_fullsized":"2024-09-22T03:16:05.774123+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8306688,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1014,"num_write_kb":8112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"58'959","reported_seq":972,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.561653+0000","last_change":"2024-09-22T03:15:17.555497+0000","last_active":"2024-09-22T03:16:06.561653+0000","last_peered":"2024-09-22T03:16:06.561653+0000","last_clean":"2024-09-22T03:16:06.561653+0000","last_became_active":"2024-09-22T03:15:17.552730+0000","last_became_peered":"2024-09-22T03:15:17.552730+0000","last_unstale":"2024-09-22T03:16:06.561653+0000","last_undegraded":"2024-09-22T03:16:06.561653+0000","last_fullsized":"2024-09-22T03:16:06.561653+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"58'863","reported_seq":876,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.683907+0000","last_change":"2024-09-22T03:15:17.544468+0000","last_active":"2024-09-22T03:16:06.683907+0000","last_peered":"2024-09-22T03:16:06.683907+0000","last_clean":"2024-09-22T03:16:06.683907+0000","last_became_active":"2024-09-22T03:15:17.540930+0000","last_became_peered":"2024-09-22T03:15:17.540930+0000","last_unstale":"2024-09-22T03:16:06.683907+0000","last_undegraded":"2024-09-22T03:16:06.683907+0000","last_fullsized":"2024-09-22T03:16:06.683907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"58'967","reported_seq":980,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.752741+0000","last_change":"2024-09-22T03:15:17.551900+0000","last_active":"2024-09-22T03:16:05.752741+0000","last_peered":"2024-09-22T03:16:05.752741+0000","last_clean":"2024-09-22T03:16:05.752741+0000","last_became_active":"2024-09-22T03:15:17.548859+0000","last_became_peered":"2024-09-22T03:15:17.548859+0000","last_unstale":"2024-09-22T03:16:05.752741+0000","last_undegraded":"2024-09-22T03:16:05.752741+0000","last_fullsized":"2024-09-22T03:16:05.752741+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"58'887","reported_seq":900,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.745472+0000","last_change":"2024-09-22T03:15:17.559076+0000","last_active":"2024-09-22T03:16:06.745472+0000","last_peered":"2024-09-22T03:16:06.745472+0000","last_clean":"2024-09-22T03:16:06.745472+0000","last_became_active":"2024-09-22T03:15:17.551485+0000","last_became_peered":"2024-09-22T03:15:17.551485+0000","last_unstale":"2024-09-22T03:16:06.745472+0000","last_undegraded":"2024-09-22T03:16:06.745472+0000","last_fullsized":"2024-09-22T03:16:06.745472+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"58'807","reported_seq":820,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.664978+0000","last_change":"2024-09-22T03:15:17.552398+0000","last_active":"2024-09-22T03:16:05.664978+0000","last_peered":"2024-09-22T03:16:05.664978+0000","last_clean":"2024-09-22T03:16:05.664978+0000","last_became_active":"2024-09-22T03:15:17.548278+0000","last_became_peered":"2024-09-22T03:15:17.548278+0000","last_unstale":"2024-09-22T03:16:05.664978+0000","last_undegraded":"2024-09-22T03:16:05.664978+0000","last_fullsized":"2024-09-22T03:16:05.664978+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"58'695","reported_seq":708,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.195422+0000","last_change":"2024-09-22T03:15:17.613812+0000","last_active":"2024-09-22T03:16:05.195422+0000","last_peered":"2024-09-22T03:16:05.195422+0000","last_clean":"2024-09-22T03:16:05.195422+0000","last_became_active":"2024-09-22T03:15:17.608698+0000","last_became_peered":"2024-09-22T03:15:17.608698+0000","last_unstale":"2024-09-22T03:16:05.195422+0000","last_undegraded":"2024-09-22T03:16:05.195422+0000","last_fullsized":"2024-09-22T03:16:05.195422+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"58'1119","reported_seq":1132,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.645904+0000","last_change":"2024-09-22T03:15:17.560404+0000","last_active":"2024-09-22T03:16:06.645904+0000","last_peered":"2024-09-22T03:16:06.645904+0000","last_clean":"2024-09-22T03:16:06.645904+0000","last_became_active":"2024-09-22T03:15:17.553477+0000","last_became_peered":"2024-09-22T03:15:17.553477+0000","last_unstale":"2024-09-22T03:16:06.645904+0000","last_undegraded":"2024-09-22T03:16:06.645904+0000","last_fullsized":"2024-09-22T03:16:06.645904+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"58'1055","reported_seq":1068,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.476848+0000","last_change":"2024-09-22T03:15:17.580165+0000","last_active":"2024-09-22T03:16:06.476848+0000","last_peered":"2024-09-22T03:16:06.476848+0000","last_clean":"2024-09-22T03:16:06.476848+0000","last_became_active":"2024-09-22T03:15:17.575370+0000","last_became_peered":"2024-09-22T03:15:17.575370+0000","last_unstale":"2024-09-22T03:16:06.476848+0000","last_undegraded":"2024-09-22T03:16:06.476848+0000","last_fullsized":"2024-09-22T03:16:06.476848+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1055,"log_dups_size":0,"ondisk_log_size":1055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1056,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481002+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:15:18.481002+0000","last_peered":"2024-09-22T03:15:18.481002+0000","last_clean":"2024-09-22T03:15:18.481002+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:15:18.481002+0000","last_undegraded":"2024-09-22T03:15:18.481002+0000","last_fullsized":"2024-09-22T03:15:18.481002+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"58'839","reported_seq":852,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.525456+0000","last_change":"2024-09-22T03:15:17.555536+0000","last_active":"2024-09-22T03:16:06.525456+0000","last_peered":"2024-09-22T03:16:06.525456+0000","last_clean":"2024-09-22T03:16:06.525456+0000","last_became_active":"2024-09-22T03:15:17.549158+0000","last_became_peered":"2024-09-22T03:15:17.549158+0000","last_unstale":"2024-09-22T03:16:06.525456+0000","last_undegraded":"2024-09-22T03:16:06.525456+0000","last_fullsized":"2024-09-22T03:16:06.525456+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482214+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:15:18.482214+0000","last_peered":"2024-09-22T03:15:18.482214+0000","last_clean":"2024-09-22T03:15:18.482214+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:15:18.482214+0000","last_undegraded":"2024-09-22T03:15:18.482214+0000","last_fullsized":"2024-09-22T03:15:18.482214+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"58'895","reported_seq":908,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.990099+0000","last_change":"2024-09-22T03:15:17.558546+0000","last_active":"2024-09-22T03:16:05.990099+0000","last_peered":"2024-09-22T03:16:05.990099+0000","last_clean":"2024-09-22T03:16:05.990099+0000","last_became_active":"2024-09-22T03:15:17.551021+0000","last_became_peered":"2024-09-22T03:15:17.551021+0000","last_unstale":"2024-09-22T03:16:05.990099+0000","last_undegraded":"2024-09-22T03:16:05.990099+0000","last_fullsized":"2024-09-22T03:16:05.990099+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":150,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.478594+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:15:18.478594+0000","last_peered":"2024-09-22T03:15:18.478594+0000","last_clean":"2024-09-22T03:15:18.478594+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:15:18.478594+0000","last_undegraded":"2024-09-22T03:15:18.478594+0000","last_fullsized":"2024-09-22T03:15:18.478594+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"58'919","reported_seq":932,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.445333+0000","last_change":"2024-09-22T03:15:17.587320+0000","last_active":"2024-09-22T03:16:05.445333+0000","last_peered":"2024-09-22T03:16:05.445333+0000","last_clean":"2024-09-22T03:16:05.445333+0000","last_became_active":"2024-09-22T03:15:17.583134+0000","last_became_peered":"2024-09-22T03:15:17.583134+0000","last_unstale":"2024-09-22T03:16:05.445333+0000","last_undegraded":"2024-09-22T03:16:05.445333+0000","last_fullsized":"2024-09-22T03:16:05.445333+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":149,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482514+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:15:18.482514+0000","last_peered":"2024-09-22T03:15:18.482514+0000","last_clean":"2024-09-22T03:15:18.482514+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:15:18.482514+0000","last_undegraded":"2024-09-22T03:15:18.482514+0000","last_fullsized":"2024-09-22T03:15:18.482514+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":274,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484533+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:15:18.484533+0000","last_peered":"2024-09-22T03:15:18.484533+0000","last_clean":"2024-09-22T03:15:18.484533+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:15:18.484533+0000","last_undegraded":"2024-09-22T03:15:18.484533+0000","last_fullsized":"2024-09-22T03:15:18.484533+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"58'887","reported_seq":900,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.602886+0000","last_change":"2024-09-22T03:15:17.537196+0000","last_active":"2024-09-22T03:16:05.602886+0000","last_peered":"2024-09-22T03:16:05.602886+0000","last_clean":"2024-09-22T03:16:05.602886+0000","last_became_active":"2024-09-22T03:15:17.533477+0000","last_became_peered":"2024-09-22T03:15:17.533477+0000","last_unstale":"2024-09-22T03:16:05.602886+0000","last_undegraded":"2024-09-22T03:16:05.602886+0000","last_fullsized":"2024-09-22T03:16:05.602886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.479925+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:15:18.479925+0000","last_peered":"2024-09-22T03:15:18.479925+0000","last_clean":"2024-09-22T03:15:18.479925+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:15:18.479925+0000","last_undegraded":"2024-09-22T03:15:18.479925+0000","last_fullsized":"2024-09-22T03:15:18.479925+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"58'1039","reported_seq":1052,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.463640+0000","last_change":"2024-09-22T03:15:17.566685+0000","last_active":"2024-09-22T03:16:06.463640+0000","last_peered":"2024-09-22T03:16:06.463640+0000","last_clean":"2024-09-22T03:16:06.463640+0000","last_became_active":"2024-09-22T03:15:17.563064+0000","last_became_peered":"2024-09-22T03:15:17.563064+0000","last_unstale":"2024-09-22T03:16:06.463640+0000","last_undegraded":"2024-09-22T03:16:06.463640+0000","last_fullsized":"2024-09-22T03:16:06.463640+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484209+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:15:18.484209+0000","last_peered":"2024-09-22T03:15:18.484209+0000","last_clean":"2024-09-22T03:15:18.484209+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:15:18.484209+0000","last_undegraded":"2024-09-22T03:15:18.484209+0000","last_fullsized":"2024-09-22T03:15:18.484209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"58'983","reported_seq":996,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.697866+0000","last_change":"2024-09-22T03:15:17.580838+0000","last_active":"2024-09-22T03:16:05.697866+0000","last_peered":"2024-09-22T03:16:05.697866+0000","last_clean":"2024-09-22T03:16:05.697866+0000","last_became_active":"2024-09-22T03:15:17.576369+0000","last_became_peered":"2024-09-22T03:15:17.576369+0000","last_unstale":"2024-09-22T03:16:05.697866+0000","last_undegraded":"2024-09-22T03:16:05.697866+0000","last_fullsized":"2024-09-22T03:16:05.697866+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":984,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484810+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:15:18.484810+0000","last_peered":"2024-09-22T03:15:18.484810+0000","last_clean":"2024-09-22T03:15:18.484810+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:15:18.484810+0000","last_undegraded":"2024-09-22T03:15:18.484810+0000","last_fullsized":"2024-09-22T03:15:18.484810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"58'943","reported_seq":956,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.381935+0000","last_change":"2024-09-22T03:15:17.578659+0000","last_active":"2024-09-22T03:16:05.381935+0000","last_peered":"2024-09-22T03:16:05.381935+0000","last_clean":"2024-09-22T03:16:05.381935+0000","last_became_active":"2024-09-22T03:15:17.572652+0000","last_became_peered":"2024-09-22T03:15:17.572652+0000","last_unstale":"2024-09-22T03:16:05.381935+0000","last_undegraded":"2024-09-22T03:16:05.381935+0000","last_fullsized":"2024-09-22T03:16:05.381935+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481987+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:15:18.481987+0000","last_peered":"2024-09-22T03:15:18.481987+0000","last_clean":"2024-09-22T03:15:18.481987+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:15:18.481987+0000","last_undegraded":"2024-09-22T03:15:18.481987+0000","last_fullsized":"2024-09-22T03:15:18.481987+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":121946112,"num_objects":1861,"num_object_clones":0,"num_object_copies":5583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14886,"num_write_kb":119088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":183005184,"data_stored":366010368,"data_compressed":18895884,"data_compressed_allocated":183005184,"data_compressed_original":366010368,"omap_allocated":0,"internal_metadata":0},"log_size":14870,"ondisk_log_size":14870,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":158012,"kb_used_data":48428,"kb_used_omap":0,"kb_used_meta":109568,"kb_avail":94213828,"statfs":{"total":96636764160,"available":96474959872,"internally_reserved":0,"allocated":49590272,"data_stored":98346646,"data_compressed":5067826,"data_compressed_allocated":49082368,"data_compressed_original":98164736,"omap_allocated":0,"internal_metadata":112197632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110752,"kb_used_data":37840,"kb_used_omap":0,"kb_used_meta":72896,"kb_avail":94261088,"statfs":{"total":96636764160,"available":96523354112,"internally_reserved":0,"allocated":38748160,"data_stored":77129910,"data_compressed":3972160,"data_compressed_allocated":38219776,"data_compressed_original":76931072,"omap_allocated":0,"internal_metadata":74645504},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120412,"kb_used_data":38220,"kb_used_omap":0,"kb_used_meta":82176,"kb_avail":94251428,"statfs":{"total":96636764160,"available":96513462272,"internally_reserved":0,"allocated":39137280,"data_stored":77908150,"data_compressed":4012148,"data_compressed_allocated":38608896,"data_compressed_original":77709312,"omap_allocated":0,"internal_metadata":84148224},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149832,"kb_used_data":55224,"kb_used_omap":0,"kb_used_meta":94592,"kb_avail":94222008,"statfs":{"total":96636764160,"available":96483336192,"internally_reserved":0,"allocated":56549376,"data_stored":112740515,"data_compressed":5810537,"data_compressed_allocated":56025088,"data_compressed_original":112541696,"omap_allocated":0,"internal_metadata":96862208},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":56393728,"data_stored":112787456,"data_compressed":5822877,"data_compressed_allocated":56393728,"data_compressed_original":112787456,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38825984,"data_stored":77651968,"data_compressed":4008837,"data_compressed_allocated":38825984,"data_compressed_original":77651968,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38432768,"data_stored":76865536,"data_compressed":3968426,"data_compressed_allocated":38432768,"data_compressed_original":76865536,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49352704,"data_stored":98705408,"data_compressed":5095744,"data_compressed_allocated":49352704,"data_compressed_original":98705408,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:16:07.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 49 16 15215 15199 2.42312 2.21094 0.0469743 0.0515517 2024-09-22T03:16:08.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 50 16 15489 15473 2.41747 2.14062 0.0447081 0.0516698 2024-09-22T03:16:08.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:08.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:08.771+0000 7f3c9864f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:08.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:08.777+0000 7f3c9864f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:09.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 51 16 15746 15730 2.40943 2.00781 0.106355 0.0518434 2024-09-22T03:16:10.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 52 16 16016 16000 2.40366 2.10938 0.0636345 0.051971 2024-09-22T03:16:11.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:11.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:11.153+0000 7f9369597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:11.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:11.160+0000 7f9369597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:11.552 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 53 16 16295 16279 2.39943 2.17969 0.0753069 0.0520509 2024-09-22T03:16:11.880 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:16:11.880 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:16:11.880 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:16:12.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:12.018+0000 7f8efc86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:12.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:12.027+0000 7f8efc86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:12.321 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:16:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:16:12.336 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2024-09-22T03:16:10.816093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":125821491,"num_objects":1916,"num_object_clones":0,"num_object_copies":5748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":15426,"num_write_kb":124192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15371,"ondisk_log_size":15371,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":531508,"kb_used_data":184692,"kb_used_omap":0,"kb_used_meta":346752,"kb_avail":376955852,"statfs":{"total":386547056640,"available":386002792448,"internally_reserved":0,"allocated":189124608,"data_stored":376324261,"data_compressed":19389306,"data_compressed_allocated":187035648,"data_compressed_original":375545856,"omap_allocated":0,"internal_metadata":355074048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26099712,"num_objects":399,"num_object_clones":0,"num_object_copies":1197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3186,"num_write_kb":25488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002136"},"pg_stats":[{"pgid":"9.7","version":"58'1085","reported_seq":1098,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:10.775980+0000","last_change":"2024-09-22T03:15:17.603510+0000","last_active":"2024-09-22T03:16:10.775980+0000","last_peered":"2024-09-22T03:16:10.775980+0000","last_clean":"2024-09-22T03:16:10.775980+0000","last_became_active":"2024-09-22T03:15:17.598775+0000","last_became_peered":"2024-09-22T03:15:17.598775+0000","last_unstale":"2024-09-22T03:16:10.775980+0000","last_undegraded":"2024-09-22T03:16:10.775980+0000","last_fullsized":"2024-09-22T03:16:10.775980+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8896512,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":8688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"58'959","reported_seq":972,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.561653+0000","last_change":"2024-09-22T03:15:17.555497+0000","last_active":"2024-09-22T03:16:06.561653+0000","last_peered":"2024-09-22T03:16:06.561653+0000","last_clean":"2024-09-22T03:16:06.561653+0000","last_became_active":"2024-09-22T03:15:17.552730+0000","last_became_peered":"2024-09-22T03:15:17.552730+0000","last_unstale":"2024-09-22T03:16:06.561653+0000","last_undegraded":"2024-09-22T03:16:06.561653+0000","last_fullsized":"2024-09-22T03:16:06.561653+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"58'863","reported_seq":876,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.683907+0000","last_change":"2024-09-22T03:15:17.544468+0000","last_active":"2024-09-22T03:16:06.683907+0000","last_peered":"2024-09-22T03:16:06.683907+0000","last_clean":"2024-09-22T03:16:06.683907+0000","last_became_active":"2024-09-22T03:15:17.540930+0000","last_became_peered":"2024-09-22T03:15:17.540930+0000","last_unstale":"2024-09-22T03:16:06.683907+0000","last_undegraded":"2024-09-22T03:16:06.683907+0000","last_fullsized":"2024-09-22T03:16:06.683907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"58'967","reported_seq":980,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.752741+0000","last_change":"2024-09-22T03:15:17.551900+0000","last_active":"2024-09-22T03:16:05.752741+0000","last_peered":"2024-09-22T03:16:05.752741+0000","last_clean":"2024-09-22T03:16:05.752741+0000","last_became_active":"2024-09-22T03:15:17.548859+0000","last_became_peered":"2024-09-22T03:15:17.548859+0000","last_unstale":"2024-09-22T03:16:05.752741+0000","last_undegraded":"2024-09-22T03:16:05.752741+0000","last_fullsized":"2024-09-22T03:16:05.752741+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"58'887","reported_seq":900,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.745472+0000","last_change":"2024-09-22T03:15:17.559076+0000","last_active":"2024-09-22T03:16:06.745472+0000","last_peered":"2024-09-22T03:16:06.745472+0000","last_clean":"2024-09-22T03:16:06.745472+0000","last_became_active":"2024-09-22T03:15:17.551485+0000","last_became_peered":"2024-09-22T03:15:17.551485+0000","last_unstale":"2024-09-22T03:16:06.745472+0000","last_undegraded":"2024-09-22T03:16:06.745472+0000","last_fullsized":"2024-09-22T03:16:06.745472+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"58'807","reported_seq":820,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.664978+0000","last_change":"2024-09-22T03:15:17.552398+0000","last_active":"2024-09-22T03:16:05.664978+0000","last_peered":"2024-09-22T03:16:05.664978+0000","last_clean":"2024-09-22T03:16:05.664978+0000","last_became_active":"2024-09-22T03:15:17.548278+0000","last_became_peered":"2024-09-22T03:15:17.548278+0000","last_unstale":"2024-09-22T03:16:05.664978+0000","last_undegraded":"2024-09-22T03:16:05.664978+0000","last_fullsized":"2024-09-22T03:16:05.664978+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"58'768","reported_seq":781,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:10.401007+0000","last_change":"2024-09-22T03:15:17.613812+0000","last_active":"2024-09-22T03:16:10.401007+0000","last_peered":"2024-09-22T03:16:10.401007+0000","last_clean":"2024-09-22T03:16:10.401007+0000","last_became_active":"2024-09-22T03:15:17.608698+0000","last_became_peered":"2024-09-22T03:15:17.608698+0000","last_unstale":"2024-09-22T03:16:10.401007+0000","last_undegraded":"2024-09-22T03:16:10.401007+0000","last_fullsized":"2024-09-22T03:16:10.401007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6299648,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":6152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"58'1119","reported_seq":1132,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.645904+0000","last_change":"2024-09-22T03:15:17.560404+0000","last_active":"2024-09-22T03:16:06.645904+0000","last_peered":"2024-09-22T03:16:06.645904+0000","last_clean":"2024-09-22T03:16:06.645904+0000","last_became_active":"2024-09-22T03:15:17.553477+0000","last_became_peered":"2024-09-22T03:15:17.553477+0000","last_unstale":"2024-09-22T03:16:06.645904+0000","last_undegraded":"2024-09-22T03:16:06.645904+0000","last_fullsized":"2024-09-22T03:16:06.645904+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"58'1055","reported_seq":1068,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.476848+0000","last_change":"2024-09-22T03:15:17.580165+0000","last_active":"2024-09-22T03:16:06.476848+0000","last_peered":"2024-09-22T03:16:06.476848+0000","last_clean":"2024-09-22T03:16:06.476848+0000","last_became_active":"2024-09-22T03:15:17.575370+0000","last_became_peered":"2024-09-22T03:15:17.575370+0000","last_unstale":"2024-09-22T03:16:06.476848+0000","last_undegraded":"2024-09-22T03:16:06.476848+0000","last_fullsized":"2024-09-22T03:16:06.476848+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1055,"log_dups_size":0,"ondisk_log_size":1055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1056,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481002+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:15:18.481002+0000","last_peered":"2024-09-22T03:15:18.481002+0000","last_clean":"2024-09-22T03:15:18.481002+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:15:18.481002+0000","last_undegraded":"2024-09-22T03:15:18.481002+0000","last_fullsized":"2024-09-22T03:15:18.481002+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"58'839","reported_seq":852,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.525456+0000","last_change":"2024-09-22T03:15:17.555536+0000","last_active":"2024-09-22T03:16:06.525456+0000","last_peered":"2024-09-22T03:16:06.525456+0000","last_clean":"2024-09-22T03:16:06.525456+0000","last_became_active":"2024-09-22T03:15:17.549158+0000","last_became_peered":"2024-09-22T03:15:17.549158+0000","last_unstale":"2024-09-22T03:16:06.525456+0000","last_undegraded":"2024-09-22T03:16:06.525456+0000","last_fullsized":"2024-09-22T03:16:06.525456+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482214+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:15:18.482214+0000","last_peered":"2024-09-22T03:15:18.482214+0000","last_clean":"2024-09-22T03:15:18.482214+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:15:18.482214+0000","last_undegraded":"2024-09-22T03:15:18.482214+0000","last_fullsized":"2024-09-22T03:15:18.482214+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"58'895","reported_seq":908,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.990099+0000","last_change":"2024-09-22T03:15:17.558546+0000","last_active":"2024-09-22T03:16:05.990099+0000","last_peered":"2024-09-22T03:16:05.990099+0000","last_clean":"2024-09-22T03:16:05.990099+0000","last_became_active":"2024-09-22T03:15:17.551021+0000","last_became_peered":"2024-09-22T03:15:17.551021+0000","last_unstale":"2024-09-22T03:16:05.990099+0000","last_undegraded":"2024-09-22T03:16:05.990099+0000","last_fullsized":"2024-09-22T03:16:05.990099+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":150,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.478594+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:15:18.478594+0000","last_peered":"2024-09-22T03:15:18.478594+0000","last_clean":"2024-09-22T03:15:18.478594+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:15:18.478594+0000","last_undegraded":"2024-09-22T03:15:18.478594+0000","last_fullsized":"2024-09-22T03:15:18.478594+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"58'983","reported_seq":996,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:10.734224+0000","last_change":"2024-09-22T03:15:17.587320+0000","last_active":"2024-09-22T03:16:10.734224+0000","last_peered":"2024-09-22T03:16:10.734224+0000","last_clean":"2024-09-22T03:16:10.734224+0000","last_became_active":"2024-09-22T03:15:17.583134+0000","last_became_peered":"2024-09-22T03:15:17.583134+0000","last_unstale":"2024-09-22T03:16:10.734224+0000","last_undegraded":"2024-09-22T03:16:10.734224+0000","last_fullsized":"2024-09-22T03:16:10.734224+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":984,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":149,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482514+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:15:18.482514+0000","last_peered":"2024-09-22T03:15:18.482514+0000","last_clean":"2024-09-22T03:15:18.482514+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:15:18.482514+0000","last_undegraded":"2024-09-22T03:15:18.482514+0000","last_fullsized":"2024-09-22T03:15:18.482514+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":274,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484533+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:15:18.484533+0000","last_peered":"2024-09-22T03:15:18.484533+0000","last_clean":"2024-09-22T03:15:18.484533+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:15:18.484533+0000","last_undegraded":"2024-09-22T03:15:18.484533+0000","last_fullsized":"2024-09-22T03:15:18.484533+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"58'887","reported_seq":900,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:05.602886+0000","last_change":"2024-09-22T03:15:17.537196+0000","last_active":"2024-09-22T03:16:05.602886+0000","last_peered":"2024-09-22T03:16:05.602886+0000","last_clean":"2024-09-22T03:16:05.602886+0000","last_became_active":"2024-09-22T03:15:17.533477+0000","last_became_peered":"2024-09-22T03:15:17.533477+0000","last_unstale":"2024-09-22T03:16:05.602886+0000","last_undegraded":"2024-09-22T03:16:05.602886+0000","last_fullsized":"2024-09-22T03:16:05.602886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.479925+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:15:18.479925+0000","last_peered":"2024-09-22T03:15:18.479925+0000","last_clean":"2024-09-22T03:15:18.479925+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:15:18.479925+0000","last_undegraded":"2024-09-22T03:15:18.479925+0000","last_fullsized":"2024-09-22T03:15:18.479925+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"58'1039","reported_seq":1052,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:06.463640+0000","last_change":"2024-09-22T03:15:17.566685+0000","last_active":"2024-09-22T03:16:06.463640+0000","last_peered":"2024-09-22T03:16:06.463640+0000","last_clean":"2024-09-22T03:16:06.463640+0000","last_became_active":"2024-09-22T03:15:17.563064+0000","last_became_peered":"2024-09-22T03:15:17.563064+0000","last_unstale":"2024-09-22T03:16:06.463640+0000","last_undegraded":"2024-09-22T03:16:06.463640+0000","last_fullsized":"2024-09-22T03:16:06.463640+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484209+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:15:18.484209+0000","last_peered":"2024-09-22T03:15:18.484209+0000","last_clean":"2024-09-22T03:15:18.484209+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:15:18.484209+0000","last_undegraded":"2024-09-22T03:15:18.484209+0000","last_fullsized":"2024-09-22T03:15:18.484209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"58'1095","reported_seq":1108,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:10.429172+0000","last_change":"2024-09-22T03:15:17.580838+0000","last_active":"2024-09-22T03:16:10.429172+0000","last_peered":"2024-09-22T03:16:10.429172+0000","last_clean":"2024-09-22T03:16:10.429172+0000","last_became_active":"2024-09-22T03:15:17.576369+0000","last_became_peered":"2024-09-22T03:15:17.576369+0000","last_unstale":"2024-09-22T03:16:10.429172+0000","last_undegraded":"2024-09-22T03:16:10.429172+0000","last_fullsized":"2024-09-22T03:16:10.429172+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1096,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484810+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:15:18.484810+0000","last_peered":"2024-09-22T03:15:18.484810+0000","last_clean":"2024-09-22T03:15:18.484810+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:15:18.484810+0000","last_undegraded":"2024-09-22T03:15:18.484810+0000","last_fullsized":"2024-09-22T03:15:18.484810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"58'1023","reported_seq":1036,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:10.046113+0000","last_change":"2024-09-22T03:15:17.578659+0000","last_active":"2024-09-22T03:16:10.046113+0000","last_peered":"2024-09-22T03:16:10.046113+0000","last_clean":"2024-09-22T03:16:10.046113+0000","last_became_active":"2024-09-22T03:15:17.572652+0000","last_became_peered":"2024-09-22T03:15:17.572652+0000","last_unstale":"2024-09-22T03:16:10.046113+0000","last_undegraded":"2024-09-22T03:16:10.046113+0000","last_fullsized":"2024-09-22T03:16:10.046113+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481987+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:15:18.481987+0000","last_peered":"2024-09-22T03:15:18.481987+0000","last_clean":"2024-09-22T03:15:18.481987+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:15:18.481987+0000","last_undegraded":"2024-09-22T03:15:18.481987+0000","last_fullsized":"2024-09-22T03:15:18.481987+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":125231104,"num_objects":1912,"num_object_clones":0,"num_object_copies":5736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15287,"num_write_kb":122296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":188092416,"data_stored":376184832,"data_compressed":19421250,"data_compressed_allocated":188092416,"data_compressed_original":376184832,"omap_allocated":0,"internal_metadata":0},"log_size":15271,"ondisk_log_size":15271,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":158012,"kb_used_data":48428,"kb_used_omap":0,"kb_used_meta":109568,"kb_avail":94213828,"statfs":{"total":96636764160,"available":96474959872,"internally_reserved":0,"allocated":49590272,"data_stored":98346646,"data_compressed":5067826,"data_compressed_allocated":49082368,"data_compressed_original":98164736,"omap_allocated":0,"internal_metadata":112197632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110752,"kb_used_data":37840,"kb_used_omap":0,"kb_used_meta":72896,"kb_avail":94261088,"statfs":{"total":96636764160,"available":96523354112,"internally_reserved":0,"allocated":38748160,"data_stored":77129910,"data_compressed":3972160,"data_compressed_allocated":38219776,"data_compressed_original":76931072,"omap_allocated":0,"internal_metadata":74645504},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120412,"kb_used_data":38220,"kb_used_omap":0,"kb_used_meta":82176,"kb_avail":94251428,"statfs":{"total":96636764160,"available":96513462272,"internally_reserved":0,"allocated":39137280,"data_stored":77908150,"data_compressed":4012148,"data_compressed_allocated":38608896,"data_compressed_original":77709312,"omap_allocated":0,"internal_metadata":84148224},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142332,"kb_used_data":60204,"kb_used_omap":0,"kb_used_meta":82112,"kb_avail":94229508,"statfs":{"total":96636764160,"available":96491016192,"internally_reserved":0,"allocated":61648896,"data_stored":122939555,"data_compressed":6337172,"data_compressed_allocated":61124608,"data_compressed_original":122740736,"omap_allocated":0,"internal_metadata":84082688},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61480960,"data_stored":122961920,"data_compressed":6348243,"data_compressed_allocated":61480960,"data_compressed_original":122961920,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38825984,"data_stored":77651968,"data_compressed":4008837,"data_compressed_allocated":38825984,"data_compressed_original":77651968,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38432768,"data_stored":76865536,"data_compressed":3968426,"data_compressed_allocated":38432768,"data_compressed_original":76865536,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49352704,"data_stored":98705408,"data_compressed":5095744,"data_compressed_allocated":49352704,"data_compressed_original":98705408,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:16:12.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 54 16 16551 16535 2.39203 2 0.0672636 0.0522264 2024-09-22T03:16:13.356 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:13.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:13.477+0000 7f63b7cfa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:13.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:13.483+0000 7f63b7cfa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:13.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 55 16 16833 16817 2.38859 2.20312 0.0461277 0.0523046 2024-09-22T03:16:14.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 56 16 17085 17069 2.38109 1.96875 0.079795 0.0524604 2024-09-22T03:16:15.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 57 16 17361 17345 2.37714 2.15625 0.0480967 0.0525506 2024-09-22T03:16:15.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:15.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:15.895+0000 7f3641f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:15.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:15.901+0000 7f3641f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:16.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 58 16 17629 17613 2.37225 2.09375 0.0488331 0.052657 2024-09-22T03:16:17.338 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:16:17.338 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:16:17.339 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:16:17.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:16:17.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:17.483+0000 7f1f08997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:17.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:17.495+0000 7f1f08997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:17.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 59 16 17906 17890 2.36872 2.16406 0.0484297 0.0527193 2024-09-22T03:16:17.603 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:17.604 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:17.604 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:17.604 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:17.604 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:17.604 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:17.604 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:17.604 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:17.604 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:17.604 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:17.604 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:17.604 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:17.607 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:17.607 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:17.607 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:16:17.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:17.737+0000 7fe893cce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:17.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:17.750+0000 7fe893cce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:17.779 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:17.779 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:17.783 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:17.783 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:17.783 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:16:17.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:17.893+0000 7f9beb223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:17.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:17.902+0000 7f9beb223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:17.924 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:17.929 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:17.929 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:17.929 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:16:18.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:18.051+0000 7fe5e8efa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:18.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:18.060+0000 7fe5e8efa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:18.150 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:18.150 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:18.150 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:18.150 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:18.150 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:18.150 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:18.150 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:18.151 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:18.151 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:18.151 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:18.151 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:18.151 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:18.153 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:18.154 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:18.246 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:18.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:18.367+0000 7f17e5b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:18.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:18.372+0000 7f17e5b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:18.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:16:18.552680+0000 min lat: 0.00992151 max lat: 0.175042 avg lat: 0.0529408 2024-09-22T03:16:18.682 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:16:18.682 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 60 16 18143 18127 2.3601 1.85156 0.0283557 0.0529408 2024-09-22T03:16:19.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 61 16 18413 18397 2.35599 2.10938 0.0425945 0.0530287 2024-09-22T03:16:20.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:20.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 62 16 18692 18676 2.35314 2.17969 0.0668026 0.0530687 2024-09-22T03:16:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:20.658+0000 7f6d57717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:20.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:20.664+0000 7f6d57717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:21.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 63 16 18972 18956 2.35051 2.1875 0.0576374 0.0531502 2024-09-22T03:16:22.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 64 16 19223 19207 2.34442 1.96094 0.116918 0.0532654 2024-09-22T03:16:22.832 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:22.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:22.981+0000 7effda4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:22.988+0000 7effda4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:23.155 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:16:23.155 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:16:23.155 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:16:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:23.278+0000 7f22aa858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:23.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:23.286+0000 7f22aa858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:16:23.543 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:16:23.553 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 65 16 19466 19450 2.33755 1.89844 0.0594228 0.0534433 2024-09-22T03:16:23.557 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2024-09-22T03:16:22.818380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":155566643,"num_objects":2369,"num_object_clones":0,"num_object_copies":7107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":19057,"num_write_kb":153240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19002,"ondisk_log_size":19002,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":587552,"kb_used_data":228256,"kb_used_omap":0,"kb_used_meta":359232,"kb_avail":376899808,"statfs":{"total":386547056640,"available":385945403392,"internally_reserved":0,"allocated":233734144,"data_stored":465543333,"data_compressed":23996199,"data_compressed_allocated":231645184,"data_compressed_original":464764928,"omap_allocated":0,"internal_metadata":367853568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29745152,"num_objects":453,"num_object_clones":0,"num_object_copies":1359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3631,"num_write_kb":29048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002286"},"pg_stats":[{"pgid":"9.7","version":"58'1207","reported_seq":1220,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:19.978339+0000","last_change":"2024-09-22T03:15:17.603510+0000","last_active":"2024-09-22T03:16:19.978339+0000","last_peered":"2024-09-22T03:16:19.978339+0000","last_clean":"2024-09-22T03:16:19.978339+0000","last_became_active":"2024-09-22T03:15:17.598775+0000","last_became_peered":"2024-09-22T03:15:17.598775+0000","last_unstale":"2024-09-22T03:16:19.978339+0000","last_undegraded":"2024-09-22T03:16:19.978339+0000","last_fullsized":"2024-09-22T03:16:19.978339+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1207,"log_dups_size":0,"ondisk_log_size":1207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"58'1303","reported_seq":1316,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:20.910046+0000","last_change":"2024-09-22T03:15:17.555497+0000","last_active":"2024-09-22T03:16:20.910046+0000","last_peered":"2024-09-22T03:16:20.910046+0000","last_clean":"2024-09-22T03:16:20.910046+0000","last_became_active":"2024-09-22T03:15:17.552730+0000","last_became_peered":"2024-09-22T03:15:17.552730+0000","last_unstale":"2024-09-22T03:16:20.910046+0000","last_undegraded":"2024-09-22T03:16:20.910046+0000","last_fullsized":"2024-09-22T03:16:20.910046+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"58'1087","reported_seq":1100,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:21.383462+0000","last_change":"2024-09-22T03:15:17.544468+0000","last_active":"2024-09-22T03:16:21.383462+0000","last_peered":"2024-09-22T03:16:21.383462+0000","last_clean":"2024-09-22T03:16:21.383462+0000","last_became_active":"2024-09-22T03:15:17.540930+0000","last_became_peered":"2024-09-22T03:15:17.540930+0000","last_unstale":"2024-09-22T03:16:21.383462+0000","last_undegraded":"2024-09-22T03:16:21.383462+0000","last_fullsized":"2024-09-22T03:16:21.383462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1087,"log_dups_size":0,"ondisk_log_size":1087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912896,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1088,"num_write_kb":8704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"58'1302","reported_seq":1315,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:21.752625+0000","last_change":"2024-09-22T03:15:17.551900+0000","last_active":"2024-09-22T03:16:21.752625+0000","last_peered":"2024-09-22T03:16:21.752625+0000","last_clean":"2024-09-22T03:16:21.752625+0000","last_became_active":"2024-09-22T03:15:17.548859+0000","last_became_peered":"2024-09-22T03:15:17.548859+0000","last_unstale":"2024-09-22T03:16:21.752625+0000","last_undegraded":"2024-09-22T03:16:21.752625+0000","last_fullsized":"2024-09-22T03:16:21.752625+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1302,"log_dups_size":0,"ondisk_log_size":1302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10674176,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1303,"num_write_kb":10424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"58'1119","reported_seq":1132,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:21.189027+0000","last_change":"2024-09-22T03:15:17.559076+0000","last_active":"2024-09-22T03:16:21.189027+0000","last_peered":"2024-09-22T03:16:21.189027+0000","last_clean":"2024-09-22T03:16:21.189027+0000","last_became_active":"2024-09-22T03:15:17.551485+0000","last_became_peered":"2024-09-22T03:15:17.551485+0000","last_unstale":"2024-09-22T03:16:21.189027+0000","last_undegraded":"2024-09-22T03:16:21.189027+0000","last_fullsized":"2024-09-22T03:16:21.189027+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"58'1023","reported_seq":1036,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:21.559272+0000","last_change":"2024-09-22T03:15:17.552398+0000","last_active":"2024-09-22T03:16:21.559272+0000","last_peered":"2024-09-22T03:16:21.559272+0000","last_clean":"2024-09-22T03:16:21.559272+0000","last_became_active":"2024-09-22T03:15:17.548278+0000","last_became_peered":"2024-09-22T03:15:17.548278+0000","last_unstale":"2024-09-22T03:16:21.559272+0000","last_undegraded":"2024-09-22T03:16:21.559272+0000","last_fullsized":"2024-09-22T03:16:21.559272+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"58'862","reported_seq":875,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:20.778772+0000","last_change":"2024-09-22T03:15:17.613812+0000","last_active":"2024-09-22T03:16:20.778772+0000","last_peered":"2024-09-22T03:16:20.778772+0000","last_clean":"2024-09-22T03:16:20.778772+0000","last_became_active":"2024-09-22T03:15:17.608698+0000","last_became_peered":"2024-09-22T03:15:17.608698+0000","last_unstale":"2024-09-22T03:16:20.778772+0000","last_undegraded":"2024-09-22T03:16:20.778772+0000","last_fullsized":"2024-09-22T03:16:20.778772+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7069696,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":863,"num_write_kb":6904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"58'1375","reported_seq":1388,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:21.538303+0000","last_change":"2024-09-22T03:15:17.560404+0000","last_active":"2024-09-22T03:16:21.538303+0000","last_peered":"2024-09-22T03:16:21.538303+0000","last_clean":"2024-09-22T03:16:21.538303+0000","last_became_active":"2024-09-22T03:15:17.553477+0000","last_became_peered":"2024-09-22T03:15:17.553477+0000","last_unstale":"2024-09-22T03:16:21.538303+0000","last_undegraded":"2024-09-22T03:16:21.538303+0000","last_fullsized":"2024-09-22T03:16:21.538303+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1376,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"58'1303","reported_seq":1316,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:21.713426+0000","last_change":"2024-09-22T03:15:17.580165+0000","last_active":"2024-09-22T03:16:21.713426+0000","last_peered":"2024-09-22T03:16:21.713426+0000","last_clean":"2024-09-22T03:16:21.713426+0000","last_became_active":"2024-09-22T03:15:17.575370+0000","last_became_peered":"2024-09-22T03:15:17.575370+0000","last_unstale":"2024-09-22T03:16:21.713426+0000","last_undegraded":"2024-09-22T03:16:21.713426+0000","last_fullsized":"2024-09-22T03:16:21.713426+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481002+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:15:18.481002+0000","last_peered":"2024-09-22T03:15:18.481002+0000","last_clean":"2024-09-22T03:15:18.481002+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:15:18.481002+0000","last_undegraded":"2024-09-22T03:15:18.481002+0000","last_fullsized":"2024-09-22T03:15:18.481002+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"58'1023","reported_seq":1036,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:21.597655+0000","last_change":"2024-09-22T03:15:17.555536+0000","last_active":"2024-09-22T03:16:21.597655+0000","last_peered":"2024-09-22T03:16:21.597655+0000","last_clean":"2024-09-22T03:16:21.597655+0000","last_became_active":"2024-09-22T03:15:17.549158+0000","last_became_peered":"2024-09-22T03:15:17.549158+0000","last_unstale":"2024-09-22T03:16:21.597655+0000","last_undegraded":"2024-09-22T03:16:21.597655+0000","last_fullsized":"2024-09-22T03:16:21.597655+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482214+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:15:18.482214+0000","last_peered":"2024-09-22T03:15:18.482214+0000","last_clean":"2024-09-22T03:15:18.482214+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:15:18.482214+0000","last_undegraded":"2024-09-22T03:15:18.482214+0000","last_fullsized":"2024-09-22T03:15:18.482214+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"58'1239","reported_seq":1252,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:21.088395+0000","last_change":"2024-09-22T03:15:17.558546+0000","last_active":"2024-09-22T03:16:21.088395+0000","last_peered":"2024-09-22T03:16:21.088395+0000","last_clean":"2024-09-22T03:16:21.088395+0000","last_became_active":"2024-09-22T03:15:17.551021+0000","last_became_peered":"2024-09-22T03:15:17.551021+0000","last_unstale":"2024-09-22T03:16:21.088395+0000","last_undegraded":"2024-09-22T03:16:21.088395+0000","last_fullsized":"2024-09-22T03:16:21.088395+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1239,"log_dups_size":0,"ondisk_log_size":1239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":150,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.478594+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:15:18.478594+0000","last_peered":"2024-09-22T03:15:18.478594+0000","last_clean":"2024-09-22T03:15:18.478594+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:15:18.478594+0000","last_undegraded":"2024-09-22T03:15:18.478594+0000","last_fullsized":"2024-09-22T03:15:18.478594+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"58'1175","reported_seq":1188,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:20.604073+0000","last_change":"2024-09-22T03:15:17.587320+0000","last_active":"2024-09-22T03:16:20.604073+0000","last_peered":"2024-09-22T03:16:20.604073+0000","last_clean":"2024-09-22T03:16:20.604073+0000","last_became_active":"2024-09-22T03:15:17.583134+0000","last_became_peered":"2024-09-22T03:15:17.583134+0000","last_unstale":"2024-09-22T03:16:20.604073+0000","last_undegraded":"2024-09-22T03:16:20.604073+0000","last_fullsized":"2024-09-22T03:16:20.604073+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":149,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482514+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:15:18.482514+0000","last_peered":"2024-09-22T03:15:18.482514+0000","last_clean":"2024-09-22T03:15:18.482514+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:15:18.482514+0000","last_undegraded":"2024-09-22T03:15:18.482514+0000","last_fullsized":"2024-09-22T03:15:18.482514+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":274,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484533+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:15:18.484533+0000","last_peered":"2024-09-22T03:15:18.484533+0000","last_clean":"2024-09-22T03:15:18.484533+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:15:18.484533+0000","last_undegraded":"2024-09-22T03:15:18.484533+0000","last_fullsized":"2024-09-22T03:15:18.484533+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"58'1135","reported_seq":1148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:19.322832+0000","last_change":"2024-09-22T03:15:17.537196+0000","last_active":"2024-09-22T03:16:19.322832+0000","last_peered":"2024-09-22T03:16:19.322832+0000","last_clean":"2024-09-22T03:16:19.322832+0000","last_became_active":"2024-09-22T03:15:17.533477+0000","last_became_peered":"2024-09-22T03:15:17.533477+0000","last_unstale":"2024-09-22T03:16:19.322832+0000","last_undegraded":"2024-09-22T03:16:19.322832+0000","last_fullsized":"2024-09-22T03:16:19.322832+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1135,"log_dups_size":0,"ondisk_log_size":1135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.479925+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:15:18.479925+0000","last_peered":"2024-09-22T03:15:18.479925+0000","last_clean":"2024-09-22T03:15:18.479925+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:15:18.479925+0000","last_undegraded":"2024-09-22T03:15:18.479925+0000","last_fullsized":"2024-09-22T03:15:18.479925+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"58'1295","reported_seq":1308,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:21.061091+0000","last_change":"2024-09-22T03:15:17.566685+0000","last_active":"2024-09-22T03:16:21.061091+0000","last_peered":"2024-09-22T03:16:21.061091+0000","last_clean":"2024-09-22T03:16:21.061091+0000","last_became_active":"2024-09-22T03:15:17.563064+0000","last_became_peered":"2024-09-22T03:15:17.563064+0000","last_unstale":"2024-09-22T03:16:21.061091+0000","last_undegraded":"2024-09-22T03:16:21.061091+0000","last_fullsized":"2024-09-22T03:16:21.061091+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10616832,"num_objects":162,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484209+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:15:18.484209+0000","last_peered":"2024-09-22T03:15:18.484209+0000","last_clean":"2024-09-22T03:15:18.484209+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:15:18.484209+0000","last_undegraded":"2024-09-22T03:15:18.484209+0000","last_fullsized":"2024-09-22T03:15:18.484209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"58'1255","reported_seq":1268,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:20.437140+0000","last_change":"2024-09-22T03:15:17.580838+0000","last_active":"2024-09-22T03:16:20.437140+0000","last_peered":"2024-09-22T03:16:20.437140+0000","last_clean":"2024-09-22T03:16:20.437140+0000","last_became_active":"2024-09-22T03:15:17.576369+0000","last_became_peered":"2024-09-22T03:15:17.576369+0000","last_unstale":"2024-09-22T03:16:20.437140+0000","last_undegraded":"2024-09-22T03:16:20.437140+0000","last_fullsized":"2024-09-22T03:16:20.437140+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1256,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484810+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:15:18.484810+0000","last_peered":"2024-09-22T03:15:18.484810+0000","last_clean":"2024-09-22T03:15:18.484810+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:15:18.484810+0000","last_undegraded":"2024-09-22T03:15:18.484810+0000","last_fullsized":"2024-09-22T03:15:18.484810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"58'1199","reported_seq":1212,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:20.554178+0000","last_change":"2024-09-22T03:15:17.578659+0000","last_active":"2024-09-22T03:16:20.554178+0000","last_peered":"2024-09-22T03:16:20.554178+0000","last_clean":"2024-09-22T03:16:20.554178+0000","last_became_active":"2024-09-22T03:15:17.572652+0000","last_became_peered":"2024-09-22T03:15:17.572652+0000","last_unstale":"2024-09-22T03:16:20.554178+0000","last_undegraded":"2024-09-22T03:16:20.554178+0000","last_fullsized":"2024-09-22T03:16:20.554178+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481987+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:15:18.481987+0000","last_peered":"2024-09-22T03:15:18.481987+0000","last_clean":"2024-09-22T03:15:18.481987+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:15:18.481987+0000","last_undegraded":"2024-09-22T03:15:18.481987+0000","last_fullsized":"2024-09-22T03:15:18.481987+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":154976256,"num_objects":2365,"num_object_clones":0,"num_object_copies":7095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18918,"num_write_kb":151344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":232628224,"data_stored":465256448,"data_compressed":24020529,"data_compressed_allocated":232628224,"data_compressed_original":465256448,"omap_allocated":0,"internal_metadata":0},"log_size":18902,"ondisk_log_size":18902,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":171172,"kb_used_data":61588,"kb_used_omap":0,"kb_used_meta":109568,"kb_avail":94200668,"statfs":{"total":96636764160,"available":96461484032,"internally_reserved":0,"allocated":63066112,"data_stored":125298326,"data_compressed":6459496,"data_compressed_allocated":62558208,"data_compressed_original":125116416,"omap_allocated":0,"internal_metadata":112197632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113148,"kb_used_data":48556,"kb_used_omap":0,"kb_used_meta":64576,"kb_avail":94258692,"statfs":{"total":96636764160,"available":96520900608,"internally_reserved":0,"allocated":49721344,"data_stored":99076278,"data_compressed":5105377,"data_compressed_allocated":49192960,"data_compressed_original":98877440,"omap_allocated":0,"internal_metadata":66125824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":138560,"kb_used_data":48048,"kb_used_omap":0,"kb_used_meta":90496,"kb_avail":94233280,"statfs":{"total":96636764160,"available":96494878720,"internally_reserved":0,"allocated":49201152,"data_stored":98035894,"data_compressed":5051459,"data_compressed_allocated":48672768,"data_compressed_original":97837056,"omap_allocated":0,"internal_metadata":92667904},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706388,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":164672,"kb_used_data":70064,"kb_used_omap":0,"kb_used_meta":94592,"kb_avail":94207168,"statfs":{"total":96636764160,"available":96468140032,"internally_reserved":0,"allocated":71745536,"data_stored":143132835,"data_compressed":7379867,"data_compressed_allocated":71221248,"data_compressed_original":142934016,"omap_allocated":0,"internal_metadata":96862208},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":71475200,"data_stored":142950400,"data_compressed":7380363,"data_compressed_allocated":71475200,"data_compressed_original":142950400,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":48922624,"data_stored":97845248,"data_compressed":5051532,"data_compressed_allocated":48922624,"data_compressed_original":97845248,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49410048,"data_stored":98820096,"data_compressed":5102066,"data_compressed_allocated":49410048,"data_compressed_original":98820096,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":62820352,"data_stored":125640704,"data_compressed":6486568,"data_compressed_allocated":62820352,"data_compressed_original":125640704,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:16:24.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 66 16 19720 19704 2.3322 1.98438 0.0486535 0.0535697 2024-09-22T03:16:25.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:25.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:25.382+0000 7f4f3dd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:25.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:25.388+0000 7f4f3dd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:25.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 67 16 19963 19947 2.32572 1.89844 0.0570402 0.053725 2024-09-22T03:16:26.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 68 16 20222 20206 2.32128 2.02344 0.0417754 0.0538213 2024-09-22T03:16:27.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 69 16 20471 20455 2.31583 1.94531 0.0603382 0.0539357 2024-09-22T03:16:27.660 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:27.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:27.816+0000 7fca80063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:27.827+0000 7fca80063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:28.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 70 16 20722 20706 2.31075 1.96094 0.0250648 0.0540673 2024-09-22T03:16:28.558 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:16:28.558 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:16:28.559 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:16:28.559 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:16:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:28.697+0000 7f668ccb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:28.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:28.709+0000 7f668ccb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:28.810 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:28.810 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:28.810 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:28.810 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:28.812 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:28.813 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:28.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:16:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:28.937+0000 7f02a6197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:28.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:28.950+0000 7f02a6197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:28.970 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:28.973 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:28.973 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:28.973 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:16:29.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:29.114+0000 7fb465258640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:29.125+0000 7fb465258640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:29.167 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:29.167 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:29.167 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:29.167 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:29.167 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:29.167 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:29.167 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:29.168 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:29.168 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:29.168 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:29.168 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:29.168 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:29.171 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:29.171 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:29.171 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:16:29.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:29.320+0000 7f6d88357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:29.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:29.329+0000 7f6d88357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:29.388 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:29.388 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:29.392 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:29.393 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:29.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 71 16 20992 20976 2.30792 2.10938 0.0451823 0.0541292 2024-09-22T03:16:29.993 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:30.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:30.121+0000 7f2f92eba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:30.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:30.127+0000 7f2f92eba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:30.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 72 16 21239 21223 2.30266 1.92969 0.0494367 0.0542597 2024-09-22T03:16:31.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 73 16 21463 21447 2.29509 1.75 0.110037 0.0544258 2024-09-22T03:16:32.341 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:32.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:32.490+0000 7f94b4397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:32.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:32.498+0000 7f94b4397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:32.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 74 16 21747 21731 2.29405 2.21875 0.0644573 0.054467 2024-09-22T03:16:33.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 75 16 22002 21986 2.29003 1.99219 0.0482194 0.0545505 2024-09-22T03:16:34.394 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:16:34.394 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:16:34.394 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:16:34.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:16:34.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:34.533+0000 7f19ee157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:34.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:34.542+0000 7f19ee157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:34.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 76 16 22247 22231 2.28508 1.91406 0.0631629 0.054667 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:34.573 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:34.573 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:34.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:16:34.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:34.716+0000 7fa257917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:34.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:34.725+0000 7fa257917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:34.745 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:34.745 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:34.745 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:34.745 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:34.746 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:34.746 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:34.746 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:34.746 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:34.746 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:34.746 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:34.746 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:34.746 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:34.749 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:34.749 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:34.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:16:34.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:34.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:34.892+0000 7fc68706c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:34.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:34.904+0000 7fc68706c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:34.926 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:34.926 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:34.926 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:34.926 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:34.926 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:34.926 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:34.926 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:34.926 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:34.926 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:34.927 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:34.927 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:34.927 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:34.929 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:34.930 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:34.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:16:34.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:34.935+0000 7fd19cd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:34.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:34.942+0000 7fd19cd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:35.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:35.051+0000 7ffb29b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:35.060+0000 7ffb29b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:35.080 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:35.080 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:35.080 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:35.080 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:35.080 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:35.080 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:35.080 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:35.080 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:35.080 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:35.080 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:35.081 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:35.081 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:35.084 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:35.084 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:35.554 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 77 16 22468 22452 2.27782 1.72656 0.0975138 0.054838 2024-09-22T03:16:36.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 78 16 22705 22689 2.27236 1.85156 0.111895 0.0549652 2024-09-22T03:16:37.110 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:37.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:37.246+0000 7fbe2fa58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:37.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:37.255+0000 7fbe2fa58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:37.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 79 16 22936 22920 2.26643 1.80469 0.0746217 0.0551182 2024-09-22T03:16:38.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:16:38.554291+0000 min lat: 0.00992151 max lat: 0.188752 avg lat: 0.0552113 2024-09-22T03:16:38.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:16:38.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 80 16 23186 23170 2.26252 1.95312 0.0907968 0.0552113 2024-09-22T03:16:39.452 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:39.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 81 16 23427 23411 2.25783 1.88281 0.0580281 0.0553371 2024-09-22T03:16:39.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:39.561+0000 7f5729597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:39.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:39.568+0000 7f5729597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:40.085 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:16:40.085 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:16:40.086 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:16:40.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:16:40.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:40.204+0000 7f0984197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:40.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:40.215+0000 7f0984197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:40.386 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:40.386 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:40.386 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:40.386 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:40.386 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:40.386 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:40.386 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:40.386 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:40.386 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:40.386 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:40.387 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:40.387 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:40.390 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:40.390 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:40.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:16:40.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:40.540+0000 7f88b9397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:40.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:40.550+0000 7f88b9397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:40.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 82 16 23636 23620 2.2502 1.63281 0.0640701 0.0555227 2024-09-22T03:16:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:40.568 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:40.568 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:40.568 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:40.568 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:40.568 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:40.568 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:40.571 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:40.571 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:40.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:16:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:40.699+0000 7f2557e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:40.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:40.710+0000 7f2557e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:40.729 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:40.733 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:40.733 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:40.733 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:16:40.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:40.857+0000 7fbadf397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:40.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:40.866+0000 7fbadf397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:40.934 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:40.934 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:40.934 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:40.935 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:40.935 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:40.935 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:40.935 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:40.935 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:40.935 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:40.935 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:40.935 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:40.935 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:40.937 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:40.938 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:41.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 83 16 23839 23823 2.2422 1.58594 0.0821629 0.05571 2024-09-22T03:16:41.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:41.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:41.967+0000 7fad0e2c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:41.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:41.972+0000 7fad0e2c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:42.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 84 16 24093 24077 2.23913 1.98438 0.0494989 0.0558009 2024-09-22T03:16:43.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 85 16 24329 24313 2.23447 1.84375 0.0607892 0.0559128 2024-09-22T03:16:44.098 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:44.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:44.226+0000 7f00a60fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:44.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:44.233+0000 7f00a60fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:44.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 86 16 24565 24549 2.22993 1.84375 0.0957916 0.0560119 2024-09-22T03:16:45.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 87 16 24804 24788 2.22576 1.86719 0.0329539 0.0561445 2024-09-22T03:16:45.938 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:16:45.938 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:16:45.939 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:16:45.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:16:46.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:46.051+0000 7ff94b06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:46.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:46.061+0000 7ff94b06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:46.103 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:46.103 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:46.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:16:46.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:46.239+0000 7f5bb346c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:46.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:46.250+0000 7f5bb346c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:46.269 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:46.269 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:46.269 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:46.269 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:46.270 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:46.270 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:46.270 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:46.270 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:46.270 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:46.270 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:46.270 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:46.270 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:46.274 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:46.275 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:46.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:16:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:46.400+0000 7f7e1f86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:46.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:46.413+0000 7f7e1f86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:46.458 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:46.458 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:46.458 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:46.461 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:46.461 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:46.462 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:16:46.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:46.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 88 16 25032 25016 2.2207 1.78125 0.0748672 0.0562592 2024-09-22T03:16:46.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:46.606+0000 7f006242c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:46.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:46.617+0000 7f006242c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:46.641 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:46.641 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:46.641 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:46.638+0000 7f18b9ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:46.645 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:46.645 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:46.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:46.646+0000 7f18b9ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:47.555 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 89 16 25245 25229 2.21445 1.66406 0.0502604 0.0564314 2024-09-22T03:16:48.556 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 90 15 25510 25495 2.21293 2.07812 0.047979 0.0564655 2024-09-22T03:16:48.818 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:48.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:48.917+0000 7fb3bab97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:48.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:48.921+0000 7fb3bab97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:49.556 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total time run: 90.0586 2024-09-22T03:16:49.556 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total writes made: 25510 2024-09-22T03:16:49.556 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Write size: 8192 2024-09-22T03:16:49.556 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object size: 65536 2024-09-22T03:16:49.556 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Bandwidth (MB/sec): 2.21297 2024-09-22T03:16:49.556 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Bandwidth: 0.306728 2024-09-22T03:16:49.556 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max bandwidth (MB/sec): 2.89844 2024-09-22T03:16:49.556 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min bandwidth (MB/sec): 1.58594 2024-09-22T03:16:49.556 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average IOPS: 283 2024-09-22T03:16:49.557 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev IOPS: 39.2612 2024-09-22T03:16:49.557 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max IOPS: 371 2024-09-22T03:16:49.557 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min IOPS: 203 2024-09-22T03:16:49.557 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average Latency(s): 0.0564675 2024-09-22T03:16:49.557 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Latency(s): 0.0248271 2024-09-22T03:16:49.557 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max latency(s): 0.188752 2024-09-22T03:16:49.557 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min latency(s): 0.00992151 2024-09-22T03:16:49.573 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:16:50.994 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:51.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:51.139+0000 7f4f84ea9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:51.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:51.151+0000 7f4f84ea9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:51.646 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:16:51.646 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:16:51.646 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:16:51.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:16:51.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:51.778+0000 7f45b0957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:51.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:51.792+0000 7f45b0957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:51.928 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:51.928 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:51.928 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:51.928 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:51.928 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:51.929 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:51.929 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:51.929 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:51.929 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:51.929 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:51.929 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:51.929 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:51.932 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:51.933 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:51.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:16:52.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:52.058+0000 7f2c9a8c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:52.072+0000 7f2c9a8c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:52.093 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:52.093 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:52.093 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:52.093 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:52.093 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:52.093 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:52.093 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:52.093 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:52.093 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:52.093 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:52.094 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:52.094 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:52.097 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:52.097 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:52.098 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:16:52.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:52.249+0000 7f415af97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:52.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:52.261+0000 7f415af97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:52.283 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:52.283 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:52.283 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:52.283 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:52.283 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:52.283 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:52.284 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:52.284 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:52.284 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:52.284 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:52.284 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:52.284 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:52.287 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:52.287 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:52.287 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:16:52.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:52.421+0000 7f07e8d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:52.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:52.434+0000 7f07e8d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:52.496 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:16:52.496 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:16:52.496 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:16:52.496 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:16:52.496 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:16:52.497 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:16:52.497 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:16:52.497 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:16:52.497 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:16:52.497 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:16:52.497 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:16:52.497 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:16:52.499 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:16:52.499 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:16:53.392 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:53.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:53.523+0000 7f37cf957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:53.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:53.530+0000 7f37cf957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:55.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:16:55.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:55.887+0000 7fad90858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:55.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:55.893+0000 7fad90858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:57.500 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:16:57.500 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:16:57.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:16:57.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:57.634+0000 7f00ff2b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:57.646+0000 7f00ff2b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:16:57.924 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":431,"stamp":"2024-09-22T03:16:56.824551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85770827,"num_objects":1305,"num_object_clones":0,"num_object_copies":3915,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":27539,"num_write_kb":205977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27484,"ondisk_log_size":27484,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":527108,"kb_used_data":135812,"kb_used_omap":0,"kb_used_meta":391168,"kb_avail":376960252,"statfs":{"total":386547056640,"available":386007298048,"internally_reserved":0,"allocated":139071488,"data_stored":276193517,"data_compressed":14222307,"data_compressed_allocated":136970240,"data_compressed_original":275415040,"omap_allocated":0,"internal_metadata":400556032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-109985768,"num_objects":-1678,"num_object_clones":0,"num_object_copies":-5034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3576,"num_write_kb":13489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002035"},"pg_stats":[{"pgid":"9.7","version":"58'1820","reported_seq":1833,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:55.770248+0000","last_change":"2024-09-22T03:15:17.603510+0000","last_active":"2024-09-22T03:16:55.770248+0000","last_peered":"2024-09-22T03:16:55.770248+0000","last_clean":"2024-09-22T03:16:55.770248+0000","last_became_active":"2024-09-22T03:15:17.598775+0000","last_became_peered":"2024-09-22T03:15:17.598775+0000","last_unstale":"2024-09-22T03:16:55.770248+0000","last_undegraded":"2024-09-22T03:16:55.770248+0000","last_fullsized":"2024-09-22T03:16:55.770248+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1820,"log_dups_size":0,"ondisk_log_size":1820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1821,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"58'1792","reported_seq":1805,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:56.667457+0000","last_change":"2024-09-22T03:15:17.555497+0000","last_active":"2024-09-22T03:16:56.667457+0000","last_peered":"2024-09-22T03:16:56.667457+0000","last_clean":"2024-09-22T03:16:56.667457+0000","last_became_active":"2024-09-22T03:15:17.552730+0000","last_became_peered":"2024-09-22T03:15:17.552730+0000","last_unstale":"2024-09-22T03:16:56.667457+0000","last_undegraded":"2024-09-22T03:16:56.667457+0000","last_fullsized":"2024-09-22T03:16:56.667457+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1792,"log_dups_size":0,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1793,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"58'1562","reported_seq":1575,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:56.712332+0000","last_change":"2024-09-22T03:15:17.544468+0000","last_active":"2024-09-22T03:16:56.712332+0000","last_peered":"2024-09-22T03:16:56.712332+0000","last_clean":"2024-09-22T03:16:56.712332+0000","last_became_active":"2024-09-22T03:15:17.540930+0000","last_became_peered":"2024-09-22T03:15:17.540930+0000","last_unstale":"2024-09-22T03:16:56.712332+0000","last_undegraded":"2024-09-22T03:16:56.712332+0000","last_fullsized":"2024-09-22T03:16:56.712332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1562,"log_dups_size":0,"ondisk_log_size":1562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1563,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"58'1882","reported_seq":1895,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:56.654123+0000","last_change":"2024-09-22T03:15:17.551900+0000","last_active":"2024-09-22T03:16:56.654123+0000","last_peered":"2024-09-22T03:16:56.654123+0000","last_clean":"2024-09-22T03:16:56.654123+0000","last_became_active":"2024-09-22T03:15:17.548859+0000","last_became_peered":"2024-09-22T03:15:17.548859+0000","last_unstale":"2024-09-22T03:16:56.654123+0000","last_undegraded":"2024-09-22T03:16:56.654123+0000","last_fullsized":"2024-09-22T03:16:56.654123+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1883,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"58'1633","reported_seq":1646,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:56.625189+0000","last_change":"2024-09-22T03:15:17.559076+0000","last_active":"2024-09-22T03:16:56.625189+0000","last_peered":"2024-09-22T03:16:56.625189+0000","last_clean":"2024-09-22T03:16:56.625189+0000","last_became_active":"2024-09-22T03:15:17.551485+0000","last_became_peered":"2024-09-22T03:15:17.551485+0000","last_unstale":"2024-09-22T03:16:56.625189+0000","last_undegraded":"2024-09-22T03:16:56.625189+0000","last_fullsized":"2024-09-22T03:16:56.625189+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1633,"log_dups_size":0,"ondisk_log_size":1633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"58'1489","reported_seq":1502,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:56.572602+0000","last_change":"2024-09-22T03:15:17.552398+0000","last_active":"2024-09-22T03:16:56.572602+0000","last_peered":"2024-09-22T03:16:56.572602+0000","last_clean":"2024-09-22T03:16:56.572602+0000","last_became_active":"2024-09-22T03:15:17.548278+0000","last_became_peered":"2024-09-22T03:15:17.548278+0000","last_unstale":"2024-09-22T03:16:56.572602+0000","last_undegraded":"2024-09-22T03:16:56.572602+0000","last_fullsized":"2024-09-22T03:16:56.572602+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1489,"log_dups_size":0,"ondisk_log_size":1489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1490,"num_write_kb":11072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"58'1301","reported_seq":1314,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:55.776056+0000","last_change":"2024-09-22T03:15:17.613812+0000","last_active":"2024-09-22T03:16:55.776056+0000","last_peered":"2024-09-22T03:16:55.776056+0000","last_clean":"2024-09-22T03:16:55.776056+0000","last_became_active":"2024-09-22T03:15:17.608698+0000","last_became_peered":"2024-09-22T03:15:17.608698+0000","last_unstale":"2024-09-22T03:16:55.776056+0000","last_undegraded":"2024-09-22T03:16:55.776056+0000","last_fullsized":"2024-09-22T03:16:55.776056+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1301,"log_dups_size":0,"ondisk_log_size":1301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1302,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"58'1991","reported_seq":2004,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:56.538047+0000","last_change":"2024-09-22T03:15:17.560404+0000","last_active":"2024-09-22T03:16:56.538047+0000","last_peered":"2024-09-22T03:16:56.538047+0000","last_clean":"2024-09-22T03:16:56.538047+0000","last_became_active":"2024-09-22T03:15:17.553477+0000","last_became_peered":"2024-09-22T03:15:17.553477+0000","last_unstale":"2024-09-22T03:16:56.538047+0000","last_undegraded":"2024-09-22T03:16:56.538047+0000","last_fullsized":"2024-09-22T03:16:56.538047+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":14784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"58'1754","reported_seq":1767,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:56.685022+0000","last_change":"2024-09-22T03:15:17.580165+0000","last_active":"2024-09-22T03:16:56.685022+0000","last_peered":"2024-09-22T03:16:56.685022+0000","last_clean":"2024-09-22T03:16:56.685022+0000","last_became_active":"2024-09-22T03:15:17.575370+0000","last_became_peered":"2024-09-22T03:15:17.575370+0000","last_unstale":"2024-09-22T03:16:56.685022+0000","last_undegraded":"2024-09-22T03:16:56.685022+0000","last_fullsized":"2024-09-22T03:16:56.685022+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1755,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481002+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:15:18.481002+0000","last_peered":"2024-09-22T03:15:18.481002+0000","last_clean":"2024-09-22T03:15:18.481002+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:15:18.481002+0000","last_undegraded":"2024-09-22T03:15:18.481002+0000","last_fullsized":"2024-09-22T03:15:18.481002+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"58'1531","reported_seq":1544,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:56.782467+0000","last_change":"2024-09-22T03:15:17.555536+0000","last_active":"2024-09-22T03:16:56.782467+0000","last_peered":"2024-09-22T03:16:56.782467+0000","last_clean":"2024-09-22T03:16:56.782467+0000","last_became_active":"2024-09-22T03:15:17.549158+0000","last_became_peered":"2024-09-22T03:15:17.549158+0000","last_unstale":"2024-09-22T03:16:56.782467+0000","last_undegraded":"2024-09-22T03:16:56.782467+0000","last_fullsized":"2024-09-22T03:16:56.782467+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1531,"log_dups_size":0,"ondisk_log_size":1531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4440064,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1532,"num_write_kb":11376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482214+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:15:18.482214+0000","last_peered":"2024-09-22T03:15:18.482214+0000","last_clean":"2024-09-22T03:15:18.482214+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:15:18.482214+0000","last_undegraded":"2024-09-22T03:15:18.482214+0000","last_fullsized":"2024-09-22T03:15:18.482214+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"58'1793","reported_seq":1806,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:56.682938+0000","last_change":"2024-09-22T03:15:17.558546+0000","last_active":"2024-09-22T03:16:56.682938+0000","last_peered":"2024-09-22T03:16:56.682938+0000","last_clean":"2024-09-22T03:16:56.682938+0000","last_became_active":"2024-09-22T03:15:17.551021+0000","last_became_peered":"2024-09-22T03:15:17.551021+0000","last_unstale":"2024-09-22T03:16:56.682938+0000","last_undegraded":"2024-09-22T03:16:56.682938+0000","last_fullsized":"2024-09-22T03:16:56.682938+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1794,"num_write_kb":13376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":150,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.478594+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:15:18.478594+0000","last_peered":"2024-09-22T03:15:18.478594+0000","last_clean":"2024-09-22T03:15:18.478594+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:15:18.478594+0000","last_undegraded":"2024-09-22T03:15:18.478594+0000","last_fullsized":"2024-09-22T03:15:18.478594+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"58'1673","reported_seq":1686,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:55.685905+0000","last_change":"2024-09-22T03:15:17.587320+0000","last_active":"2024-09-22T03:16:55.685905+0000","last_peered":"2024-09-22T03:16:55.685905+0000","last_clean":"2024-09-22T03:16:55.685905+0000","last_became_active":"2024-09-22T03:15:17.583134+0000","last_became_peered":"2024-09-22T03:15:17.583134+0000","last_unstale":"2024-09-22T03:16:55.685905+0000","last_undegraded":"2024-09-22T03:16:55.685905+0000","last_fullsized":"2024-09-22T03:16:55.685905+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1673,"log_dups_size":0,"ondisk_log_size":1673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1674,"num_write_kb":12544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":149,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482514+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:15:18.482514+0000","last_peered":"2024-09-22T03:15:18.482514+0000","last_clean":"2024-09-22T03:15:18.482514+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:15:18.482514+0000","last_undegraded":"2024-09-22T03:15:18.482514+0000","last_fullsized":"2024-09-22T03:15:18.482514+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":274,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484533+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:15:18.484533+0000","last_peered":"2024-09-22T03:15:18.484533+0000","last_clean":"2024-09-22T03:15:18.484533+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:15:18.484533+0000","last_undegraded":"2024-09-22T03:15:18.484533+0000","last_fullsized":"2024-09-22T03:15:18.484533+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"58'1683","reported_seq":1696,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:56.681068+0000","last_change":"2024-09-22T03:15:17.537196+0000","last_active":"2024-09-22T03:16:56.681068+0000","last_peered":"2024-09-22T03:16:56.681068+0000","last_clean":"2024-09-22T03:16:56.681068+0000","last_became_active":"2024-09-22T03:15:17.533477+0000","last_became_peered":"2024-09-22T03:15:17.533477+0000","last_unstale":"2024-09-22T03:16:56.681068+0000","last_undegraded":"2024-09-22T03:16:56.681068+0000","last_fullsized":"2024-09-22T03:16:56.681068+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1683,"log_dups_size":0,"ondisk_log_size":1683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1684,"num_write_kb":12544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.479925+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:15:18.479925+0000","last_peered":"2024-09-22T03:15:18.479925+0000","last_clean":"2024-09-22T03:15:18.479925+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:15:18.479925+0000","last_undegraded":"2024-09-22T03:15:18.479925+0000","last_fullsized":"2024-09-22T03:15:18.479925+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"58'1830","reported_seq":1844,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:56.595147+0000","last_change":"2024-09-22T03:15:17.566685+0000","last_active":"2024-09-22T03:16:56.595147+0000","last_peered":"2024-09-22T03:16:56.595147+0000","last_clean":"2024-09-22T03:16:56.595147+0000","last_became_active":"2024-09-22T03:15:17.563064+0000","last_became_peered":"2024-09-22T03:15:17.563064+0000","last_unstale":"2024-09-22T03:16:56.595147+0000","last_undegraded":"2024-09-22T03:16:56.595147+0000","last_fullsized":"2024-09-22T03:16:56.595147+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111832,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1831,"num_write_kb":13569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484209+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:15:18.484209+0000","last_peered":"2024-09-22T03:15:18.484209+0000","last_clean":"2024-09-22T03:15:18.484209+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:15:18.484209+0000","last_undegraded":"2024-09-22T03:15:18.484209+0000","last_fullsized":"2024-09-22T03:15:18.484209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"58'1898","reported_seq":1911,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:55.709176+0000","last_change":"2024-09-22T03:15:17.580838+0000","last_active":"2024-09-22T03:16:55.709176+0000","last_peered":"2024-09-22T03:16:55.709176+0000","last_clean":"2024-09-22T03:16:55.709176+0000","last_became_active":"2024-09-22T03:15:17.576369+0000","last_became_peered":"2024-09-22T03:15:17.576369+0000","last_unstale":"2024-09-22T03:16:55.709176+0000","last_undegraded":"2024-09-22T03:16:55.709176+0000","last_fullsized":"2024-09-22T03:16:55.709176+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1898,"log_dups_size":0,"ondisk_log_size":1898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1899,"num_write_kb":14272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484810+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:15:18.484810+0000","last_peered":"2024-09-22T03:15:18.484810+0000","last_clean":"2024-09-22T03:15:18.484810+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:15:18.484810+0000","last_undegraded":"2024-09-22T03:15:18.484810+0000","last_fullsized":"2024-09-22T03:15:18.484810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"58'1752","reported_seq":1765,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:16:55.491635+0000","last_change":"2024-09-22T03:15:17.578659+0000","last_active":"2024-09-22T03:16:55.491635+0000","last_peered":"2024-09-22T03:16:55.491635+0000","last_clean":"2024-09-22T03:16:55.491635+0000","last_became_active":"2024-09-22T03:15:17.572652+0000","last_became_peered":"2024-09-22T03:15:17.572652+0000","last_unstale":"2024-09-22T03:16:55.491635+0000","last_undegraded":"2024-09-22T03:16:55.491635+0000","last_fullsized":"2024-09-22T03:16:55.491635+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1752,"log_dups_size":0,"ondisk_log_size":1752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1753,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481987+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:15:18.481987+0000","last_peered":"2024-09-22T03:15:18.481987+0000","last_clean":"2024-09-22T03:15:18.481987+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:15:18.481987+0000","last_undegraded":"2024-09-22T03:15:18.481987+0000","last_fullsized":"2024-09-22T03:15:18.481987+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":85180440,"num_objects":1301,"num_object_clones":0,"num_object_copies":3903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":27400,"num_write_kb":204081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128307200,"data_stored":256589896,"data_compressed":13249203,"data_compressed_allocated":128294912,"data_compressed_original":256589824,"omap_allocated":0,"internal_metadata":0},"log_size":27384,"ondisk_log_size":27384,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673719,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135004,"kb_used_data":33708,"kb_used_omap":0,"kb_used_meta":101248,"kb_avail":94236836,"statfs":{"total":96636764160,"available":96498520064,"internally_reserved":0,"allocated":34516992,"data_stored":68191918,"data_compressed":3511745,"data_compressed_allocated":34004992,"data_compressed_original":68009984,"omap_allocated":0,"internal_metadata":103677952},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673719,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96312,"kb_used_data":27560,"kb_used_omap":0,"kb_used_meta":68736,"kb_avail":94275528,"statfs":{"total":96636764160,"available":96538140672,"internally_reserved":0,"allocated":28221440,"data_stored":56068302,"data_compressed":2885210,"data_compressed_allocated":27688960,"data_compressed_original":55869440,"omap_allocated":0,"internal_metadata":70385664},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673719,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139324,"kb_used_data":26604,"kb_used_omap":0,"kb_used_meta":112704,"kb_avail":94232516,"statfs":{"total":96636764160,"available":96494096384,"internally_reserved":0,"allocated":27242496,"data_stored":54118582,"data_compressed":2784535,"data_compressed_allocated":26714112,"data_compressed_original":53919744,"omap_allocated":0,"internal_metadata":115408896},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706423,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":156468,"kb_used_data":47940,"kb_used_omap":0,"kb_used_meta":108480,"kb_avail":94215372,"statfs":{"total":96636764160,"available":96476540928,"internally_reserved":0,"allocated":49090560,"data_stored":97814715,"data_compressed":5040817,"data_compressed_allocated":48562176,"data_compressed_original":97615872,"omap_allocated":0,"internal_metadata":111083520},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45707264,"data_stored":91406360,"data_compressed":4719833,"data_compressed_allocated":45703168,"data_compressed_original":91406336,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24870912,"data_stored":49741824,"data_compressed":2568455,"data_compressed_allocated":24870912,"data_compressed_original":49741824,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25849856,"data_stored":51691544,"data_compressed":2669130,"data_compressed_allocated":25845760,"data_compressed_original":51691520,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31879168,"data_stored":63750168,"data_compressed":3291785,"data_compressed_allocated":31875072,"data_compressed_original":63750144,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:16:58.207 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:16:58.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:58.338+0000 7f6af2597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:16:58.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:16:58.344+0000 7f6af2597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:00.709 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:00.855+0000 7feb52458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:00.861+0000 7feb52458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:01.444 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Removed 3189 objects 2024-09-22T03:17:01.444 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Clean up completed and total clean up time :11.8705 2024-09-22T03:17:02.213 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_6 2024-09-22T03:17:02.213 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_6 unique_pool_6 --yes-i-really-really-mean-it 2024-09-22T03:17:02.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:02.318+0000 7f76ecf0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:02.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:02.329+0000 7f76ecf0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:02.943 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:17:02.943 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:17:02.944 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:17:03.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:03.044+0000 7f33c534e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:03.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:03.050+0000 7f33c534e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:03.127 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:03.227+0000 7fddd690e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:17:03.232 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:17:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:03.232+0000 7fddd690e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:03.246 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":434,"stamp":"2024-09-22T03:17:02.825678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3867187,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":28790,"num_write_kb":205977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28735,"ondisk_log_size":28735,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":400716,"kb_used_data":9484,"kb_used_omap":0,"kb_used_meta":391168,"kb_avail":377086644,"statfs":{"total":386547056640,"available":386136723456,"internally_reserved":0,"allocated":9711616,"data_stored":17490109,"data_compressed":863970,"data_compressed_allocated":7618560,"data_compressed_original":16711680,"omap_allocated":0,"internal_metadata":400556032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-195887104,"num_objects":-2989,"num_object_clones":0,"num_object_copies":-8967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3304,"num_write_kb":2225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002117"},"pg_stats":[{"pgid":"9.7","version":"58'1905","reported_seq":1918,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:00.693354+0000","last_change":"2024-09-22T03:15:17.603510+0000","last_active":"2024-09-22T03:17:00.693354+0000","last_peered":"2024-09-22T03:17:00.693354+0000","last_clean":"2024-09-22T03:17:00.693354+0000","last_became_active":"2024-09-22T03:15:17.598775+0000","last_became_peered":"2024-09-22T03:15:17.598775+0000","last_unstale":"2024-09-22T03:17:00.693354+0000","last_undegraded":"2024-09-22T03:17:00.693354+0000","last_fullsized":"2024-09-22T03:17:00.693354+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1905,"log_dups_size":0,"ondisk_log_size":1905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1906,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"58'1871","reported_seq":1884,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:01.374469+0000","last_change":"2024-09-22T03:15:17.555497+0000","last_active":"2024-09-22T03:17:01.374469+0000","last_peered":"2024-09-22T03:17:01.374469+0000","last_clean":"2024-09-22T03:17:01.374469+0000","last_became_active":"2024-09-22T03:15:17.552730+0000","last_became_peered":"2024-09-22T03:15:17.552730+0000","last_unstale":"2024-09-22T03:17:01.374469+0000","last_undegraded":"2024-09-22T03:17:01.374469+0000","last_fullsized":"2024-09-22T03:17:01.374469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1871,"log_dups_size":0,"ondisk_log_size":1871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1872,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"58'1628","reported_seq":1641,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:01.268507+0000","last_change":"2024-09-22T03:15:17.544468+0000","last_active":"2024-09-22T03:17:01.268507+0000","last_peered":"2024-09-22T03:17:01.268507+0000","last_clean":"2024-09-22T03:17:01.268507+0000","last_became_active":"2024-09-22T03:15:17.540930+0000","last_became_peered":"2024-09-22T03:15:17.540930+0000","last_unstale":"2024-09-22T03:17:01.268507+0000","last_undegraded":"2024-09-22T03:17:01.268507+0000","last_fullsized":"2024-09-22T03:17:01.268507+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1628,"log_dups_size":0,"ondisk_log_size":1628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1629,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"58'1970","reported_seq":1983,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:01.314877+0000","last_change":"2024-09-22T03:15:17.551900+0000","last_active":"2024-09-22T03:17:01.314877+0000","last_peered":"2024-09-22T03:17:01.314877+0000","last_clean":"2024-09-22T03:17:01.314877+0000","last_became_active":"2024-09-22T03:15:17.548859+0000","last_became_peered":"2024-09-22T03:15:17.548859+0000","last_unstale":"2024-09-22T03:17:01.314877+0000","last_undegraded":"2024-09-22T03:17:01.314877+0000","last_fullsized":"2024-09-22T03:17:01.314877+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1970,"log_dups_size":0,"ondisk_log_size":1970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1971,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"58'1709","reported_seq":1722,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:01.389474+0000","last_change":"2024-09-22T03:15:17.559076+0000","last_active":"2024-09-22T03:17:01.389474+0000","last_peered":"2024-09-22T03:17:01.389474+0000","last_clean":"2024-09-22T03:17:01.389474+0000","last_became_active":"2024-09-22T03:15:17.551485+0000","last_became_peered":"2024-09-22T03:15:17.551485+0000","last_unstale":"2024-09-22T03:17:01.389474+0000","last_undegraded":"2024-09-22T03:17:01.389474+0000","last_fullsized":"2024-09-22T03:17:01.389474+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1709,"log_dups_size":0,"ondisk_log_size":1709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1710,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"58'1556","reported_seq":1569,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:01.324054+0000","last_change":"2024-09-22T03:15:17.552398+0000","last_active":"2024-09-22T03:17:01.324054+0000","last_peered":"2024-09-22T03:17:01.324054+0000","last_clean":"2024-09-22T03:17:01.324054+0000","last_became_active":"2024-09-22T03:15:17.548278+0000","last_became_peered":"2024-09-22T03:15:17.548278+0000","last_unstale":"2024-09-22T03:17:01.324054+0000","last_undegraded":"2024-09-22T03:17:01.324054+0000","last_fullsized":"2024-09-22T03:17:01.324054+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1556,"log_dups_size":0,"ondisk_log_size":1556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1557,"num_write_kb":11072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"58'1367","reported_seq":1380,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:00.451141+0000","last_change":"2024-09-22T03:15:17.613812+0000","last_active":"2024-09-22T03:17:00.451141+0000","last_peered":"2024-09-22T03:17:00.451141+0000","last_clean":"2024-09-22T03:17:00.451141+0000","last_became_active":"2024-09-22T03:15:17.608698+0000","last_became_peered":"2024-09-22T03:15:17.608698+0000","last_unstale":"2024-09-22T03:17:00.451141+0000","last_undegraded":"2024-09-22T03:17:00.451141+0000","last_fullsized":"2024-09-22T03:17:00.451141+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1367,"log_dups_size":0,"ondisk_log_size":1367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1368,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"58'2078","reported_seq":2091,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:01.367680+0000","last_change":"2024-09-22T03:15:17.560404+0000","last_active":"2024-09-22T03:17:01.367680+0000","last_peered":"2024-09-22T03:17:01.367680+0000","last_clean":"2024-09-22T03:17:01.367680+0000","last_became_active":"2024-09-22T03:15:17.553477+0000","last_became_peered":"2024-09-22T03:15:17.553477+0000","last_unstale":"2024-09-22T03:17:01.367680+0000","last_undegraded":"2024-09-22T03:17:01.367680+0000","last_fullsized":"2024-09-22T03:17:01.367680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2079,"num_write_kb":14784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"58'1817","reported_seq":1830,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:01.290446+0000","last_change":"2024-09-22T03:15:17.580165+0000","last_active":"2024-09-22T03:17:01.290446+0000","last_peered":"2024-09-22T03:17:01.290446+0000","last_clean":"2024-09-22T03:17:01.290446+0000","last_became_active":"2024-09-22T03:15:17.575370+0000","last_became_peered":"2024-09-22T03:15:17.575370+0000","last_unstale":"2024-09-22T03:17:01.290446+0000","last_undegraded":"2024-09-22T03:17:01.290446+0000","last_fullsized":"2024-09-22T03:17:01.290446+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1817,"log_dups_size":0,"ondisk_log_size":1817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481002+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:15:18.481002+0000","last_peered":"2024-09-22T03:15:18.481002+0000","last_clean":"2024-09-22T03:15:18.481002+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:15:18.481002+0000","last_undegraded":"2024-09-22T03:15:18.481002+0000","last_fullsized":"2024-09-22T03:15:18.481002+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"58'1599","reported_seq":1612,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:01.376922+0000","last_change":"2024-09-22T03:15:17.555536+0000","last_active":"2024-09-22T03:17:01.376922+0000","last_peered":"2024-09-22T03:17:01.376922+0000","last_clean":"2024-09-22T03:17:01.376922+0000","last_became_active":"2024-09-22T03:15:17.549158+0000","last_became_peered":"2024-09-22T03:15:17.549158+0000","last_unstale":"2024-09-22T03:17:01.376922+0000","last_undegraded":"2024-09-22T03:17:01.376922+0000","last_fullsized":"2024-09-22T03:17:01.376922+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1599,"log_dups_size":0,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1600,"num_write_kb":11376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482214+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:15:18.482214+0000","last_peered":"2024-09-22T03:15:18.482214+0000","last_clean":"2024-09-22T03:15:18.482214+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:15:18.482214+0000","last_undegraded":"2024-09-22T03:15:18.482214+0000","last_fullsized":"2024-09-22T03:15:18.482214+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"58'1880","reported_seq":1893,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:01.301200+0000","last_change":"2024-09-22T03:15:17.558546+0000","last_active":"2024-09-22T03:17:01.301200+0000","last_peered":"2024-09-22T03:17:01.301200+0000","last_clean":"2024-09-22T03:17:01.301200+0000","last_became_active":"2024-09-22T03:15:17.551021+0000","last_became_peered":"2024-09-22T03:15:17.551021+0000","last_unstale":"2024-09-22T03:17:01.301200+0000","last_undegraded":"2024-09-22T03:17:01.301200+0000","last_fullsized":"2024-09-22T03:17:01.301200+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1880,"log_dups_size":0,"ondisk_log_size":1880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1881,"num_write_kb":13376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":150,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.478594+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:15:18.478594+0000","last_peered":"2024-09-22T03:15:18.478594+0000","last_clean":"2024-09-22T03:15:18.478594+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:15:18.478594+0000","last_undegraded":"2024-09-22T03:15:18.478594+0000","last_fullsized":"2024-09-22T03:15:18.478594+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"58'1751","reported_seq":1764,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:00.658004+0000","last_change":"2024-09-22T03:15:17.587320+0000","last_active":"2024-09-22T03:17:00.658004+0000","last_peered":"2024-09-22T03:17:00.658004+0000","last_clean":"2024-09-22T03:17:00.658004+0000","last_became_active":"2024-09-22T03:15:17.583134+0000","last_became_peered":"2024-09-22T03:15:17.583134+0000","last_unstale":"2024-09-22T03:17:00.658004+0000","last_undegraded":"2024-09-22T03:17:00.658004+0000","last_fullsized":"2024-09-22T03:17:00.658004+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1752,"num_write_kb":12544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":149,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.482514+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:15:18.482514+0000","last_peered":"2024-09-22T03:15:18.482514+0000","last_clean":"2024-09-22T03:15:18.482514+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:15:18.482514+0000","last_undegraded":"2024-09-22T03:15:18.482514+0000","last_fullsized":"2024-09-22T03:15:18.482514+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":274,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484533+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:15:18.484533+0000","last_peered":"2024-09-22T03:15:18.484533+0000","last_clean":"2024-09-22T03:15:18.484533+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:15:18.484533+0000","last_undegraded":"2024-09-22T03:15:18.484533+0000","last_fullsized":"2024-09-22T03:15:18.484533+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"58'1763","reported_seq":1776,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:01.165722+0000","last_change":"2024-09-22T03:15:17.537196+0000","last_active":"2024-09-22T03:17:01.165722+0000","last_peered":"2024-09-22T03:17:01.165722+0000","last_clean":"2024-09-22T03:17:01.165722+0000","last_became_active":"2024-09-22T03:15:17.533477+0000","last_became_peered":"2024-09-22T03:15:17.533477+0000","last_unstale":"2024-09-22T03:17:01.165722+0000","last_undegraded":"2024-09-22T03:17:01.165722+0000","last_fullsized":"2024-09-22T03:17:01.165722+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1763,"log_dups_size":0,"ondisk_log_size":1763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1764,"num_write_kb":12544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.479925+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:15:18.479925+0000","last_peered":"2024-09-22T03:15:18.479925+0000","last_clean":"2024-09-22T03:15:18.479925+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:15:18.479925+0000","last_undegraded":"2024-09-22T03:15:18.479925+0000","last_fullsized":"2024-09-22T03:15:18.479925+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"58'1909","reported_seq":1923,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:01.405853+0000","last_change":"2024-09-22T03:15:17.566685+0000","last_active":"2024-09-22T03:17:01.405853+0000","last_peered":"2024-09-22T03:17:01.405853+0000","last_clean":"2024-09-22T03:17:01.405853+0000","last_became_active":"2024-09-22T03:15:17.563064+0000","last_became_peered":"2024-09-22T03:15:17.563064+0000","last_unstale":"2024-09-22T03:17:01.405853+0000","last_undegraded":"2024-09-22T03:17:01.405853+0000","last_fullsized":"2024-09-22T03:17:01.405853+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1909,"log_dups_size":0,"ondisk_log_size":1909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1910,"num_write_kb":13569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484209+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:15:18.484209+0000","last_peered":"2024-09-22T03:15:18.484209+0000","last_clean":"2024-09-22T03:15:18.484209+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:15:18.484209+0000","last_undegraded":"2024-09-22T03:15:18.484209+0000","last_fullsized":"2024-09-22T03:15:18.484209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"58'1997","reported_seq":2010,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:00.768002+0000","last_change":"2024-09-22T03:15:17.580838+0000","last_active":"2024-09-22T03:17:00.768002+0000","last_peered":"2024-09-22T03:17:00.768002+0000","last_clean":"2024-09-22T03:17:00.768002+0000","last_became_active":"2024-09-22T03:15:17.576369+0000","last_became_peered":"2024-09-22T03:15:17.576369+0000","last_unstale":"2024-09-22T03:17:00.768002+0000","last_undegraded":"2024-09-22T03:17:00.768002+0000","last_fullsized":"2024-09-22T03:17:00.768002+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1997,"log_dups_size":0,"ondisk_log_size":1997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1998,"num_write_kb":14272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.484810+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:15:18.484810+0000","last_peered":"2024-09-22T03:15:18.484810+0000","last_clean":"2024-09-22T03:15:18.484810+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:15:18.484810+0000","last_undegraded":"2024-09-22T03:15:18.484810+0000","last_fullsized":"2024-09-22T03:15:18.484810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"58'1835","reported_seq":1848,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:17:00.631985+0000","last_change":"2024-09-22T03:15:17.578659+0000","last_active":"2024-09-22T03:17:00.631985+0000","last_peered":"2024-09-22T03:17:00.631985+0000","last_clean":"2024-09-22T03:17:00.631985+0000","last_became_active":"2024-09-22T03:15:17.572652+0000","last_became_peered":"2024-09-22T03:15:17.572652+0000","last_unstale":"2024-09-22T03:17:00.631985+0000","last_undegraded":"2024-09-22T03:17:00.631985+0000","last_fullsized":"2024-09-22T03:17:00.631985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:15:16.465006+0000","last_clean_scrub_stamp":"2024-09-22T03:15:16.465006+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1836,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":148,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:15:18.481987+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:15:18.481987+0000","last_peered":"2024-09-22T03:15:18.481987+0000","last_clean":"2024-09-22T03:15:18.481987+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:15:18.481987+0000","last_undegraded":"2024-09-22T03:15:18.481987+0000","last_fullsized":"2024-09-22T03:15:18.481987+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28651,"num_write_kb":204081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5042176,"data_stored":10076184,"data_compressed":520290,"data_compressed_allocated":5038080,"data_compressed_original":10076160,"omap_allocated":0,"internal_metadata":0},"log_size":28635,"ondisk_log_size":28635,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673724,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105920,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":105408,"kb_avail":94265920,"statfs":{"total":96636764160,"available":96528302080,"internally_reserved":0,"allocated":507904,"data_stored":181910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":107937792},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673724,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73468,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":72896,"kb_avail":94298372,"statfs":{"total":96636764160,"available":96561532928,"internally_reserved":0,"allocated":569344,"data_stored":772278,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":74645504},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673724,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":100796,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":100224,"kb_avail":94271044,"statfs":{"total":96636764160,"available":96533549056,"internally_reserved":0,"allocated":569344,"data_stored":772278,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":102629376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706428,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120532,"kb_used_data":7876,"kb_used_omap":0,"kb_used_meta":112640,"kb_avail":94251308,"statfs":{"total":96636764160,"available":96513339392,"internally_reserved":0,"allocated":8065024,"data_stored":15763643,"data_compressed":804050,"data_compressed_allocated":7536640,"data_compressed_original":15564800,"omap_allocated":0,"internal_metadata":115343360},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5042176,"data_stored":10076184,"data_compressed":520290,"data_compressed_allocated":5038080,"data_compressed_original":10076160,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:17:03.464 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_6' removed 2024-09-22T03:17:03.480 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:17:03.480 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:17:03.480 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_7 2024-09-22T03:17:03.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_7 16 2024-09-22T03:17:03.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:03.605+0000 7f3e12197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:03.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:03.617+0000 7f3e12197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:04.465 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_7' created 2024-09-22T03:17:04.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_7 rados --yes-i-really-mean-it || true 2024-09-22T03:17:04.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:04.600+0000 7fa4ae063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:04.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:04.612+0000 7fa4ae063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:05.309 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:05.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:05.412+0000 7fab31b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:05.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:05.417+0000 7fab31b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:05.475 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rados' on pool 'unique_pool_7' 2024-09-22T03:17:06.499 DEBUG:teuthology.orchestra.run.smithi134:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_7 bench 90 write' 2024-09-22T03:17:06.502 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:17:06.502 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:17:06.565 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:hints = 1 2024-09-22T03:17:06.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:17:06.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object prefix: benchmark_data_smithi134_61156 2024-09-22T03:17:06.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:17:06.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:17:07.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:07.565 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 1 16 367 351 2.74197 2.74219 0.0550613 0.0439237 2024-09-22T03:17:07.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:07.639+0000 7f651a397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:07.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:07.646+0000 7f651a397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:08.248 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:17:08.248 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:17:08.248 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:17:08.248 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:17:08.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:08.385+0000 7f8919063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:08.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:08.395+0000 7f8919063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:08.436 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:08.436 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:08.436 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:08.436 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:08.436 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:08.436 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:08.437 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:08.437 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:08.437 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:08.437 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:08.437 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:08.437 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:08.439 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:08.440 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:08.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:17:08.565 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 2 16 704 688 2.68729 2.63281 0.0652926 0.0455454 2024-09-22T03:17:08.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:08.586+0000 7f46cdf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:08.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:08.596+0000 7f46cdf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:08.624 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:08.624 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:08.624 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:08.624 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:08.624 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:08.625 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:08.625 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:08.625 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:08.625 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:08.625 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:08.625 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:08.625 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:08.627 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:08.628 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:08.628 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:17:08.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:08.755+0000 7f40b0317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:08.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:08.766+0000 7f40b0317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:08.832 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:08.832 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:08.832 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:08.832 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:08.832 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:08.832 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:08.832 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:08.832 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:08.832 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:08.832 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:08.833 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:08.833 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:08.836 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:08.836 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:08.836 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:17:08.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:08.969+0000 7f0552557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:08.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:08.981+0000 7f0552557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:09.006 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:09.006 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:09.010 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:09.010 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:09.565 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 3 16 1031 1015 2.64302 2.55469 0.0256735 0.0470865 2024-09-22T03:17:09.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:09.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:09.916+0000 7f89946ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:09.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:09.922+0000 7f89946ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:10.565 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 4 16 1372 1356 2.64822 2.66406 0.0495473 0.0469956 2024-09-22T03:17:11.565 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 5 16 1717 1701 2.65762 2.69531 0.0643696 0.0468383 2024-09-22T03:17:12.139 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:12.295+0000 7ff861717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:12.301+0000 7ff861717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:12.565 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 6 16 2088 2072 2.69772 2.89844 0.0291871 0.046206 2024-09-22T03:17:13.565 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 7 16 2428 2412 2.69177 2.65625 0.0292753 0.0462903 2024-09-22T03:17:14.011 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:17:14.011 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:17:14.011 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:17:14.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:14.165+0000 7f577e2b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:14.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:14.173+0000 7f577e2b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:17:14.455 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:17:14.468 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2024-09-22T03:17:12.827517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14246451,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":1806,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1751,"ondisk_log_size":1751,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":443176,"kb_used_data":21416,"kb_used_omap":0,"kb_used_meta":421696,"kb_avail":377044184,"statfs":{"total":386547056640,"available":386093244416,"internally_reserved":0,"allocated":21929984,"data_stored":41696529,"data_compressed":2107644,"data_compressed_allocated":19693568,"data_compressed_original":40861696,"omap_allocated":0,"internal_metadata":431816704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13656064,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1667,"num_write_kb":13336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001328"},"pg_stats":[{"pgid":"10.7","version":"62'79","reported_seq":92,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:09.709647+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:17:09.709647+0000","last_peered":"2024-09-22T03:17:09.709647+0000","last_clean":"2024-09-22T03:17:09.709647+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:17:09.709647+0000","last_undegraded":"2024-09-22T03:17:09.709647+0000","last_fullsized":"2024-09-22T03:17:09.709647+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"62'127","reported_seq":140,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:11.679960+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:17:11.679960+0000","last_peered":"2024-09-22T03:17:11.679960+0000","last_clean":"2024-09-22T03:17:11.679960+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:17:11.679960+0000","last_undegraded":"2024-09-22T03:17:11.679960+0000","last_fullsized":"2024-09-22T03:17:11.679960+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"62'95","reported_seq":108,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:11.558136+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:17:11.558136+0000","last_peered":"2024-09-22T03:17:11.558136+0000","last_clean":"2024-09-22T03:17:11.558136+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:17:11.558136+0000","last_undegraded":"2024-09-22T03:17:11.558136+0000","last_fullsized":"2024-09-22T03:17:11.558136+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"62'143","reported_seq":156,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:11.793439+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:17:11.793439+0000","last_peered":"2024-09-22T03:17:11.793439+0000","last_clean":"2024-09-22T03:17:11.793439+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:17:11.793439+0000","last_undegraded":"2024-09-22T03:17:11.793439+0000","last_fullsized":"2024-09-22T03:17:11.793439+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"62'55","reported_seq":68,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:09.335034+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:17:09.335034+0000","last_peered":"2024-09-22T03:17:09.335034+0000","last_clean":"2024-09-22T03:17:09.335034+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:17:09.335034+0000","last_undegraded":"2024-09-22T03:17:09.335034+0000","last_fullsized":"2024-09-22T03:17:09.335034+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"62'111","reported_seq":124,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:11.529447+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:17:11.529447+0000","last_peered":"2024-09-22T03:17:11.529447+0000","last_clean":"2024-09-22T03:17:11.529447+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:17:11.529447+0000","last_undegraded":"2024-09-22T03:17:11.529447+0000","last_fullsized":"2024-09-22T03:17:11.529447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"62'71","reported_seq":84,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:10.760488+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:17:10.760488+0000","last_peered":"2024-09-22T03:17:10.760488+0000","last_clean":"2024-09-22T03:17:10.760488+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:17:10.760488+0000","last_undegraded":"2024-09-22T03:17:10.760488+0000","last_fullsized":"2024-09-22T03:17:10.760488+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"62'127","reported_seq":140,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:11.369748+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:17:11.369748+0000","last_peered":"2024-09-22T03:17:11.369748+0000","last_clean":"2024-09-22T03:17:11.369748+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:17:11.369748+0000","last_undegraded":"2024-09-22T03:17:11.369748+0000","last_fullsized":"2024-09-22T03:17:11.369748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"62'167","reported_seq":180,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:11.616504+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:17:11.616504+0000","last_peered":"2024-09-22T03:17:11.616504+0000","last_clean":"2024-09-22T03:17:11.616504+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:17:11.616504+0000","last_undegraded":"2024-09-22T03:17:11.616504+0000","last_fullsized":"2024-09-22T03:17:11.616504+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.483442+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:17:06.483442+0000","last_peered":"2024-09-22T03:17:06.483442+0000","last_clean":"2024-09-22T03:17:06.483442+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:17:06.483442+0000","last_undegraded":"2024-09-22T03:17:06.483442+0000","last_fullsized":"2024-09-22T03:17:06.483442+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"62'39","reported_seq":52,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:10.084915+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:17:10.084915+0000","last_peered":"2024-09-22T03:17:10.084915+0000","last_clean":"2024-09-22T03:17:10.084915+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:17:10.084915+0000","last_undegraded":"2024-09-22T03:17:10.084915+0000","last_fullsized":"2024-09-22T03:17:10.084915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.484350+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:17:06.484350+0000","last_peered":"2024-09-22T03:17:06.484350+0000","last_clean":"2024-09-22T03:17:06.484350+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:17:06.484350+0000","last_undegraded":"2024-09-22T03:17:06.484350+0000","last_fullsized":"2024-09-22T03:17:06.484350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"62'95","reported_seq":108,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:11.090417+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:17:11.090417+0000","last_peered":"2024-09-22T03:17:11.090417+0000","last_clean":"2024-09-22T03:17:11.090417+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:17:11.090417+0000","last_undegraded":"2024-09-22T03:17:11.090417+0000","last_fullsized":"2024-09-22T03:17:11.090417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":162,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.511553+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:17:06.511553+0000","last_peered":"2024-09-22T03:17:06.511553+0000","last_clean":"2024-09-22T03:17:06.511553+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:17:06.511553+0000","last_undegraded":"2024-09-22T03:17:06.511553+0000","last_fullsized":"2024-09-22T03:17:06.511553+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"62'130","reported_seq":143,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:11.756762+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:17:11.756762+0000","last_peered":"2024-09-22T03:17:11.756762+0000","last_clean":"2024-09-22T03:17:11.756762+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:17:11.756762+0000","last_undegraded":"2024-09-22T03:17:11.756762+0000","last_fullsized":"2024-09-22T03:17:11.756762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1073152,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":1048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":161,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.486123+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:17:06.486123+0000","last_peered":"2024-09-22T03:17:06.486123+0000","last_clean":"2024-09-22T03:17:06.486123+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:17:06.486123+0000","last_undegraded":"2024-09-22T03:17:06.486123+0000","last_fullsized":"2024-09-22T03:17:06.486123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":286,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.492577+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:17:06.492577+0000","last_peered":"2024-09-22T03:17:06.492577+0000","last_clean":"2024-09-22T03:17:06.492577+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:17:06.492577+0000","last_undegraded":"2024-09-22T03:17:06.492577+0000","last_fullsized":"2024-09-22T03:17:06.492577+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"62'119","reported_seq":132,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:11.184523+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:17:11.184523+0000","last_peered":"2024-09-22T03:17:11.184523+0000","last_clean":"2024-09-22T03:17:11.184523+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:17:11.184523+0000","last_undegraded":"2024-09-22T03:17:11.184523+0000","last_fullsized":"2024-09-22T03:17:11.184523+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.486373+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:17:06.486373+0000","last_peered":"2024-09-22T03:17:06.486373+0000","last_clean":"2024-09-22T03:17:06.486373+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:17:06.486373+0000","last_undegraded":"2024-09-22T03:17:06.486373+0000","last_fullsized":"2024-09-22T03:17:06.486373+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"62'79","reported_seq":92,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:10.658370+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:17:10.658370+0000","last_peered":"2024-09-22T03:17:10.658370+0000","last_clean":"2024-09-22T03:17:10.658370+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:17:10.658370+0000","last_undegraded":"2024-09-22T03:17:10.658370+0000","last_fullsized":"2024-09-22T03:17:10.658370+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.513821+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:17:06.513821+0000","last_peered":"2024-09-22T03:17:06.513821+0000","last_clean":"2024-09-22T03:17:06.513821+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:17:06.513821+0000","last_undegraded":"2024-09-22T03:17:06.513821+0000","last_fullsized":"2024-09-22T03:17:06.513821+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"62'119","reported_seq":132,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:10.530210+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:17:10.530210+0000","last_peered":"2024-09-22T03:17:10.530210+0000","last_clean":"2024-09-22T03:17:10.530210+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:17:10.530210+0000","last_undegraded":"2024-09-22T03:17:10.530210+0000","last_fullsized":"2024-09-22T03:17:10.530210+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.491352+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:17:06.491352+0000","last_peered":"2024-09-22T03:17:06.491352+0000","last_clean":"2024-09-22T03:17:06.491352+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:17:06.491352+0000","last_undegraded":"2024-09-22T03:17:06.491352+0000","last_fullsized":"2024-09-22T03:17:06.491352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"62'95","reported_seq":108,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:09.558405+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:17:09.558405+0000","last_peered":"2024-09-22T03:17:09.558405+0000","last_clean":"2024-09-22T03:17:09.558405+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:17:09.558405+0000","last_undegraded":"2024-09-22T03:17:09.558405+0000","last_fullsized":"2024-09-22T03:17:09.558405+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.492123+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:17:06.492123+0000","last_peered":"2024-09-22T03:17:06.492123+0000","last_clean":"2024-09-22T03:17:06.492123+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:17:06.492123+0000","last_undegraded":"2024-09-22T03:17:06.492123+0000","last_fullsized":"2024-09-22T03:17:06.492123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":13656064,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1667,"num_write_kb":13336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20946944,"data_stored":41893888,"data_compressed":2159892,"data_compressed_allocated":20946944,"data_compressed_original":41893888,"omap_allocated":0,"internal_metadata":0},"log_size":1651,"ondisk_log_size":1651,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113884,"kb_used_data":4300,"kb_used_omap":0,"kb_used_meta":109568,"kb_avail":94257956,"statfs":{"total":96636764160,"available":96520146944,"internally_reserved":0,"allocated":4403200,"data_stored":7912881,"data_compressed":397788,"data_compressed_allocated":3858432,"data_compressed_original":7716864,"omap_allocated":0,"internal_metadata":112197632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105792,"kb_used_data":6512,"kb_used_omap":0,"kb_used_meta":99264,"kb_avail":94266048,"statfs":{"total":96636764160,"available":96528433152,"internally_reserved":0,"allocated":6668288,"data_stored":12910545,"data_compressed":655066,"data_compressed_allocated":6103040,"data_compressed_original":12697600,"omap_allocated":0,"internal_metadata":101646336},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114372,"kb_used_data":5812,"kb_used_omap":0,"kb_used_meta":108544,"kb_avail":94257468,"statfs":{"total":96636764160,"available":96519647232,"internally_reserved":0,"allocated":5951488,"data_stored":11476945,"data_compressed":581159,"data_compressed_allocated":5386240,"data_compressed_original":11264000,"omap_allocated":0,"internal_metadata":111149056},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":109128,"kb_used_data":4792,"kb_used_omap":0,"kb_used_meta":104320,"kb_avail":94262712,"statfs":{"total":96636764160,"available":96525017088,"internally_reserved":0,"allocated":4907008,"data_stored":9396158,"data_compressed":473631,"data_compressed_allocated":4345856,"data_compressed_original":9183232,"omap_allocated":0,"internal_metadata":106823680},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4591616,"data_stored":9183232,"data_compressed":473281,"data_compressed_allocated":4591616,"data_compressed_original":9183232,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5652480,"data_stored":11304960,"data_compressed":582924,"data_compressed_allocated":5652480,"data_compressed_original":11304960,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6467584,"data_stored":12935168,"data_compressed":666983,"data_compressed_allocated":6467584,"data_compressed_original":12935168,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4235264,"data_stored":8470528,"data_compressed":436704,"data_compressed_allocated":4235264,"data_compressed_original":8470528,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:17:14.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:14.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 8 16 2755 2739 2.67461 2.55469 0.0548218 0.0465634 2024-09-22T03:17:14.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:14.625+0000 7f254f66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:14.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:14.630+0000 7f254f66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:15.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 9 16 3127 3111 2.70032 2.90625 0.0609446 0.0461634 2024-09-22T03:17:16.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 10 16 3462 3446 2.69199 2.61719 0.049428 0.0463001 2024-09-22T03:17:16.862 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:16.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:16.991+0000 7fec4422c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:17.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:16.999+0000 7fec4422c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:17.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 11 16 3802 3786 2.68872 2.65625 0.0844065 0.0464001 2024-09-22T03:17:18.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 12 16 4174 4158 2.70683 2.90625 0.0370775 0.0460961 2024-09-22T03:17:19.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:19.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:19.298+0000 7fe28f157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:19.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:19.304+0000 7fe28f157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:19.469 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:17:19.470 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:17:19.470 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:17:19.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 13 16 4505 4489 2.69751 2.58594 0.0517226 0.0462114 2024-09-22T03:17:19.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:19.613+0000 7f44facfa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:19.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:19.623+0000 7f44facfa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:19.953 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:17:19.954 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:17:19.969 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2024-09-22T03:17:18.828599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28353075,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":3528,"num_write_kb":29008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3473,"ondisk_log_size":3473,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":463948,"kb_used_data":42188,"kb_used_omap":0,"kb_used_meta":421696,"kb_avail":377023412,"statfs":{"total":386547056640,"available":386071973888,"internally_reserved":0,"allocated":43200512,"data_stored":84237585,"data_compressed":4304283,"data_compressed_allocated":40964096,"data_compressed_original":83402752,"omap_allocated":0,"internal_metadata":431816704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27344896,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3338,"num_write_kb":26704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002074"},"pg_stats":[{"pgid":"10.7","version":"62'223","reported_seq":236,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:15.537017+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:17:15.537017+0000","last_peered":"2024-09-22T03:17:15.537017+0000","last_clean":"2024-09-22T03:17:15.537017+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:17:15.537017+0000","last_undegraded":"2024-09-22T03:17:15.537017+0000","last_fullsized":"2024-09-22T03:17:15.537017+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"62'223","reported_seq":236,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:16.606022+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:17:16.606022+0000","last_peered":"2024-09-22T03:17:16.606022+0000","last_clean":"2024-09-22T03:17:16.606022+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:17:16.606022+0000","last_undegraded":"2024-09-22T03:17:16.606022+0000","last_fullsized":"2024-09-22T03:17:16.606022+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"62'188","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:16.757395+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:17:16.757395+0000","last_peered":"2024-09-22T03:17:16.757395+0000","last_clean":"2024-09-22T03:17:16.757395+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:17:16.757395+0000","last_undegraded":"2024-09-22T03:17:16.757395+0000","last_fullsized":"2024-09-22T03:17:16.757395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548288,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":1512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"62'247","reported_seq":260,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:15.499548+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:17:15.499548+0000","last_peered":"2024-09-22T03:17:15.499548+0000","last_clean":"2024-09-22T03:17:15.499548+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:17:15.499548+0000","last_undegraded":"2024-09-22T03:17:15.499548+0000","last_fullsized":"2024-09-22T03:17:15.499548+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"62'167","reported_seq":180,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:15.037388+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:17:15.037388+0000","last_peered":"2024-09-22T03:17:15.037388+0000","last_clean":"2024-09-22T03:17:15.037388+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:17:15.037388+0000","last_undegraded":"2024-09-22T03:17:15.037388+0000","last_fullsized":"2024-09-22T03:17:15.037388+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"62'215","reported_seq":228,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:16.347829+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:17:16.347829+0000","last_peered":"2024-09-22T03:17:16.347829+0000","last_clean":"2024-09-22T03:17:16.347829+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:17:16.347829+0000","last_undegraded":"2024-09-22T03:17:16.347829+0000","last_fullsized":"2024-09-22T03:17:16.347829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"62'183","reported_seq":196,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:15.473122+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:17:15.473122+0000","last_peered":"2024-09-22T03:17:15.473122+0000","last_clean":"2024-09-22T03:17:15.473122+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:17:15.473122+0000","last_undegraded":"2024-09-22T03:17:15.473122+0000","last_fullsized":"2024-09-22T03:17:15.473122+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"62'239","reported_seq":252,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:16.688175+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:17:16.688175+0000","last_peered":"2024-09-22T03:17:16.688175+0000","last_clean":"2024-09-22T03:17:16.688175+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:17:16.688175+0000","last_undegraded":"2024-09-22T03:17:16.688175+0000","last_fullsized":"2024-09-22T03:17:16.688175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"62'255","reported_seq":268,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:16.725841+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:17:16.725841+0000","last_peered":"2024-09-22T03:17:16.725841+0000","last_clean":"2024-09-22T03:17:16.725841+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:17:16.725841+0000","last_undegraded":"2024-09-22T03:17:16.725841+0000","last_fullsized":"2024-09-22T03:17:16.725841+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.483442+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:17:06.483442+0000","last_peered":"2024-09-22T03:17:06.483442+0000","last_clean":"2024-09-22T03:17:06.483442+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:17:06.483442+0000","last_undegraded":"2024-09-22T03:17:06.483442+0000","last_fullsized":"2024-09-22T03:17:06.483442+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"62'183","reported_seq":196,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:15.379605+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:17:15.379605+0000","last_peered":"2024-09-22T03:17:15.379605+0000","last_clean":"2024-09-22T03:17:15.379605+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:17:15.379605+0000","last_undegraded":"2024-09-22T03:17:15.379605+0000","last_fullsized":"2024-09-22T03:17:15.379605+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.484350+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:17:06.484350+0000","last_peered":"2024-09-22T03:17:06.484350+0000","last_clean":"2024-09-22T03:17:06.484350+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:17:06.484350+0000","last_undegraded":"2024-09-22T03:17:06.484350+0000","last_fullsized":"2024-09-22T03:17:06.484350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"62'167","reported_seq":180,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:16.496811+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:17:16.496811+0000","last_peered":"2024-09-22T03:17:16.496811+0000","last_clean":"2024-09-22T03:17:16.496811+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:17:16.496811+0000","last_undegraded":"2024-09-22T03:17:16.496811+0000","last_fullsized":"2024-09-22T03:17:16.496811+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":162,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.511553+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:17:06.511553+0000","last_peered":"2024-09-22T03:17:06.511553+0000","last_clean":"2024-09-22T03:17:06.511553+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:17:06.511553+0000","last_undegraded":"2024-09-22T03:17:06.511553+0000","last_fullsized":"2024-09-22T03:17:06.511553+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"62'239","reported_seq":252,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:16.600885+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:17:16.600885+0000","last_peered":"2024-09-22T03:17:16.600885+0000","last_clean":"2024-09-22T03:17:16.600885+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:17:16.600885+0000","last_undegraded":"2024-09-22T03:17:16.600885+0000","last_fullsized":"2024-09-22T03:17:16.600885+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":161,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.486123+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:17:06.486123+0000","last_peered":"2024-09-22T03:17:06.486123+0000","last_clean":"2024-09-22T03:17:06.486123+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:17:06.486123+0000","last_undegraded":"2024-09-22T03:17:06.486123+0000","last_fullsized":"2024-09-22T03:17:06.486123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":286,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.492577+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:17:06.492577+0000","last_peered":"2024-09-22T03:17:06.492577+0000","last_clean":"2024-09-22T03:17:06.492577+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:17:06.492577+0000","last_undegraded":"2024-09-22T03:17:06.492577+0000","last_fullsized":"2024-09-22T03:17:06.492577+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"62'199","reported_seq":212,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:16.050665+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:17:16.050665+0000","last_peered":"2024-09-22T03:17:16.050665+0000","last_clean":"2024-09-22T03:17:16.050665+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:17:16.050665+0000","last_undegraded":"2024-09-22T03:17:16.050665+0000","last_fullsized":"2024-09-22T03:17:16.050665+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.486373+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:17:06.486373+0000","last_peered":"2024-09-22T03:17:06.486373+0000","last_clean":"2024-09-22T03:17:06.486373+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:17:06.486373+0000","last_undegraded":"2024-09-22T03:17:06.486373+0000","last_fullsized":"2024-09-22T03:17:06.486373+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"62'215","reported_seq":228,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:15.610960+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:17:15.610960+0000","last_peered":"2024-09-22T03:17:15.610960+0000","last_clean":"2024-09-22T03:17:15.610960+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:17:15.610960+0000","last_undegraded":"2024-09-22T03:17:15.610960+0000","last_fullsized":"2024-09-22T03:17:15.610960+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.513821+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:17:06.513821+0000","last_peered":"2024-09-22T03:17:06.513821+0000","last_clean":"2024-09-22T03:17:06.513821+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:17:06.513821+0000","last_undegraded":"2024-09-22T03:17:06.513821+0000","last_fullsized":"2024-09-22T03:17:06.513821+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"62'231","reported_seq":244,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:15.676726+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:17:15.676726+0000","last_peered":"2024-09-22T03:17:15.676726+0000","last_clean":"2024-09-22T03:17:15.676726+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:17:15.676726+0000","last_undegraded":"2024-09-22T03:17:15.676726+0000","last_fullsized":"2024-09-22T03:17:15.676726+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.491352+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:17:06.491352+0000","last_peered":"2024-09-22T03:17:06.491352+0000","last_clean":"2024-09-22T03:17:06.491352+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:17:06.491352+0000","last_undegraded":"2024-09-22T03:17:06.491352+0000","last_fullsized":"2024-09-22T03:17:06.491352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"62'199","reported_seq":212,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:15.405728+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:17:15.405728+0000","last_peered":"2024-09-22T03:17:15.405728+0000","last_clean":"2024-09-22T03:17:15.405728+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:17:15.405728+0000","last_undegraded":"2024-09-22T03:17:15.405728+0000","last_fullsized":"2024-09-22T03:17:15.405728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.492123+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:17:06.492123+0000","last_peered":"2024-09-22T03:17:06.492123+0000","last_clean":"2024-09-22T03:17:06.492123+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:17:06.492123+0000","last_undegraded":"2024-09-22T03:17:06.492123+0000","last_fullsized":"2024-09-22T03:17:06.492123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":27762688,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3389,"num_write_kb":27112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":42250240,"data_stored":84500480,"data_compressed":4359915,"data_compressed_allocated":42250240,"data_compressed_original":84500480,"omap_allocated":0,"internal_metadata":0},"log_size":3373,"ondisk_log_size":3373,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121996,"kb_used_data":8252,"kb_used_omap":0,"kb_used_meta":113728,"kb_avail":94249844,"statfs":{"total":96636764160,"available":96511840256,"internally_reserved":0,"allocated":8450048,"data_stored":16006577,"data_compressed":815712,"data_compressed_allocated":7905280,"data_compressed_original":15810560,"omap_allocated":0,"internal_metadata":116457472},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99564,"kb_used_data":12764,"kb_used_omap":0,"kb_used_meta":86784,"kb_avail":94272276,"statfs":{"total":96636764160,"available":96534810624,"internally_reserved":0,"allocated":13070336,"data_stored":25714641,"data_compressed":1316215,"data_compressed_allocated":12505088,"data_compressed_original":25501696,"omap_allocated":0,"internal_metadata":88866816},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123440,"kb_used_data":10720,"kb_used_omap":0,"kb_used_meta":112704,"kb_avail":94248400,"statfs":{"total":96636764160,"available":96510361600,"internally_reserved":0,"allocated":10977280,"data_stored":21528529,"data_compressed":1100180,"data_compressed_allocated":10412032,"data_compressed_original":21315584,"omap_allocated":0,"internal_metadata":115408896},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118948,"kb_used_data":10452,"kb_used_omap":0,"kb_used_meta":108480,"kb_avail":94252892,"statfs":{"total":96636764160,"available":96514961408,"internally_reserved":0,"allocated":10702848,"data_stored":20987838,"data_compressed":1072176,"data_compressed_allocated":10141696,"data_compressed_original":20774912,"omap_allocated":0,"internal_metadata":111083520},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10465280,"data_stored":20930560,"data_compressed":1079863,"data_compressed_allocated":10465280,"data_compressed_original":20930560,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10719232,"data_stored":21438464,"data_compressed":1106175,"data_compressed_allocated":10719232,"data_compressed_original":21438464,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12861440,"data_stored":25722880,"data_compressed":1327286,"data_compressed_allocated":12861440,"data_compressed_original":25722880,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8204288,"data_stored":16408576,"data_compressed":846591,"data_compressed_allocated":8204288,"data_compressed_original":16408576,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:17:20.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 14 16 4822 4806 2.68171 2.47656 0.0481948 0.0465284 2024-09-22T03:17:21.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:21.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 15 16 5166 5150 2.68208 2.6875 0.0814513 0.0464982 2024-09-22T03:17:21.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:21.568+0000 7f0b8eb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:21.575+0000 7f0b8eb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:22.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 16 16 5530 5514 2.69217 2.84375 0.056311 0.0463366 2024-09-22T03:17:23.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 17 16 5878 5862 2.69372 2.71875 0.0375875 0.046326 2024-09-22T03:17:23.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:23.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:23.814+0000 7fed98397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:23.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:23.821+0000 7fed98397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:24.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 18 16 6186 6170 2.67774 2.40625 0.0512317 0.046607 2024-09-22T03:17:24.972 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:17:24.972 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:17:24.972 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:17:24.972 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:17:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:25.132+0000 7f87ae597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:25.143+0000 7f87ae597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:25.193 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:25.193 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:25.194 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:17:25.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:25.339+0000 7f0786997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:25.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:25.350+0000 7f0786997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:25.385 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:25.385 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:25.386 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:17:25.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:25.527+0000 7fbf83f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:25.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:25.536+0000 7fbf83f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:25.560 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:25.561 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:25.561 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:25.561 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:25.561 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:25.561 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:25.561 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:25.561 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:25.561 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:25.561 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:25.561 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:25.561 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:25.565 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:25.565 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:25.565 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:17:25.566 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 19 16 6497 6481 2.66468 2.42969 0.0325339 0.0468284 2024-09-22T03:17:25.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:25.708+0000 7f48cc797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:25.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:25.724+0000 7f48cc797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:25.747 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:25.750 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:25.751 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:26.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:26.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:26.228+0000 7f9659597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:26.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:26.235+0000 7f9659597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:26.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:17:26.566086+0000 min lat: 0.00903376 max lat: 0.153061 avg lat: 0.0470008 2024-09-22T03:17:26.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:17:26.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 20 16 6817 6801 2.65643 2.5 0.0460316 0.0470008 2024-09-22T03:17:27.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 21 16 7129 7113 2.646 2.4375 0.0767833 0.0471225 2024-09-22T03:17:28.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:28.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:28.473+0000 7f577a8d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:28.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:28.480+0000 7f577a8d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:28.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 22 16 7465 7449 2.64503 2.625 0.0415874 0.0472016 2024-09-22T03:17:29.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 23 16 7806 7790 2.64585 2.66406 0.0372645 0.0471793 2024-09-22T03:17:30.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 24 16 8151 8135 2.6479 2.69531 0.0469863 0.0471454 2024-09-22T03:17:30.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:30.751 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:17:30.751 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:17:30.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:30.768+0000 7f603d46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:30.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:30.779+0000 7f603d46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:30.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:30.904+0000 7f423dd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:30.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:30.920+0000 7f423dd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:31.466 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:17:31.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:17:31.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 25 16 8423 8407 2.62698 2.125 0.0722518 0.0475186 2024-09-22T03:17:31.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:31.617+0000 7f7744597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:31.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:31.629+0000 7f7744597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:32.471 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:17:32.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:17:32.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 26 16 8731 8715 2.61848 2.40625 0.0399852 0.0476903 2024-09-22T03:17:32.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:32.631+0000 7f023d757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:32.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:32.643+0000 7f023d757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:32.953 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:33.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:33.092+0000 7fd42ce6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:33.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:33.098+0000 7fd42ce6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:33.480 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:17:33.505 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:17:33.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 27 16 9012 8996 2.6028 2.19531 0.0588549 0.0479712 2024-09-22T03:17:33.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:33.641+0000 7f92a0f0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:33.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:33.655+0000 7f92a0f0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:34.491 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:17:34.509 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:17:34.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:17:34.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 28 16 9313 9297 2.59382 2.35156 0.128273 0.0481193 2024-09-22T03:17:34.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:34.647+0000 7f431c397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:34.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:34.658+0000 7f431c397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:34.889 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:17:34.889 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:17:34.906 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":458,"stamp":"2024-09-22T03:17:34.831502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68977203,"num_objects":1049,"num_object_clones":0,"num_object_copies":3147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":8487,"num_write_kb":68680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8435,"ondisk_log_size":8435,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":533600,"kb_used_data":102112,"kb_used_omap":0,"kb_used_meta":431424,"kb_avail":376953760,"statfs":{"total":386547056640,"available":386000650240,"internally_reserved":0,"allocated":104562688,"data_stored":206935715,"data_compressed":10639554,"data_compressed_allocated":102309888,"data_compressed_original":206094336,"omap_allocated":0,"internal_metadata":441778176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6774784,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":6616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000658"},"pg_stats":[{"pgid":"10.7","version":"62'607","reported_seq":620,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.451006+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:17:30.451006+0000","last_peered":"2024-09-22T03:17:30.451006+0000","last_clean":"2024-09-22T03:17:30.451006+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:17:30.451006+0000","last_undegraded":"2024-09-22T03:17:30.451006+0000","last_fullsized":"2024-09-22T03:17:30.451006+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"63'559","reported_seq":575,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.764513+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:17:31.764513+0000","last_peered":"2024-09-22T03:17:31.764513+0000","last_clean":"2024-09-22T03:17:31.764513+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:17:31.764513+0000","last_undegraded":"2024-09-22T03:17:31.764513+0000","last_fullsized":"2024-09-22T03:17:31.764513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"63'492","reported_seq":508,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.756745+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:17:31.756745+0000","last_peered":"2024-09-22T03:17:31.756745+0000","last_clean":"2024-09-22T03:17:31.756745+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:17:31.756745+0000","last_undegraded":"2024-09-22T03:17:31.756745+0000","last_fullsized":"2024-09-22T03:17:31.756745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4038656,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":493,"num_write_kb":3944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"62'568","reported_seq":583,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.474134+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:17:31.474134+0000","last_peered":"2024-09-22T03:17:31.474134+0000","last_clean":"2024-09-22T03:17:31.474134+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:17:31.474134+0000","last_undegraded":"2024-09-22T03:17:31.474134+0000","last_fullsized":"2024-09-22T03:17:31.474134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"62'591","reported_seq":604,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.601060+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:17:30.601060+0000","last_peered":"2024-09-22T03:17:30.601060+0000","last_clean":"2024-09-22T03:17:30.601060+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:17:30.601060+0000","last_undegraded":"2024-09-22T03:17:30.601060+0000","last_fullsized":"2024-09-22T03:17:30.601060+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"62'440","reported_seq":455,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.471051+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:17:31.471051+0000","last_peered":"2024-09-22T03:17:31.471051+0000","last_clean":"2024-09-22T03:17:31.471051+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:17:31.471051+0000","last_undegraded":"2024-09-22T03:17:31.471051+0000","last_fullsized":"2024-09-22T03:17:31.471051+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"62'443","reported_seq":456,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.785297+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:17:30.785297+0000","last_peered":"2024-09-22T03:17:30.785297+0000","last_clean":"2024-09-22T03:17:30.785297+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:17:30.785297+0000","last_undegraded":"2024-09-22T03:17:30.785297+0000","last_fullsized":"2024-09-22T03:17:30.785297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3637248,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":3552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"63'503","reported_seq":519,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.713918+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:17:31.713918+0000","last_peered":"2024-09-22T03:17:31.713918+0000","last_clean":"2024-09-22T03:17:31.713918+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:17:31.713918+0000","last_undegraded":"2024-09-22T03:17:31.713918+0000","last_fullsized":"2024-09-22T03:17:31.713918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"63'519","reported_seq":535,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.557570+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:17:31.557570+0000","last_peered":"2024-09-22T03:17:31.557570+0000","last_clean":"2024-09-22T03:17:31.557570+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:17:31.557570+0000","last_undegraded":"2024-09-22T03:17:31.557570+0000","last_fullsized":"2024-09-22T03:17:31.557570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":163,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.471956+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:17:31.471956+0000","last_peered":"2024-09-22T03:17:31.471956+0000","last_clean":"2024-09-22T03:17:31.471956+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:17:31.471956+0000","last_undegraded":"2024-09-22T03:17:31.471956+0000","last_fullsized":"2024-09-22T03:17:31.471956+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"62'511","reported_seq":524,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:29.560429+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:17:29.560429+0000","last_peered":"2024-09-22T03:17:29.560429+0000","last_clean":"2024-09-22T03:17:29.560429+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:17:29.560429+0000","last_undegraded":"2024-09-22T03:17:29.560429+0000","last_fullsized":"2024-09-22T03:17:29.560429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.484350+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:17:06.484350+0000","last_peered":"2024-09-22T03:17:06.484350+0000","last_clean":"2024-09-22T03:17:06.484350+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:17:06.484350+0000","last_undegraded":"2024-09-22T03:17:06.484350+0000","last_fullsized":"2024-09-22T03:17:06.484350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"63'434","reported_seq":450,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.799253+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:17:31.799253+0000","last_peered":"2024-09-22T03:17:31.799253+0000","last_clean":"2024-09-22T03:17:31.799253+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:17:31.799253+0000","last_undegraded":"2024-09-22T03:17:31.799253+0000","last_fullsized":"2024-09-22T03:17:31.799253+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563520,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":165,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.471487+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:17:31.471487+0000","last_peered":"2024-09-22T03:17:31.471487+0000","last_clean":"2024-09-22T03:17:31.471487+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:17:31.471487+0000","last_undegraded":"2024-09-22T03:17:31.471487+0000","last_fullsized":"2024-09-22T03:17:31.471487+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"62'552","reported_seq":567,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.473619+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:17:31.473619+0000","last_peered":"2024-09-22T03:17:31.473619+0000","last_clean":"2024-09-22T03:17:31.473619+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:17:31.473619+0000","last_undegraded":"2024-09-22T03:17:31.473619+0000","last_fullsized":"2024-09-22T03:17:31.473619+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":164,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.474728+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:17:31.474728+0000","last_peered":"2024-09-22T03:17:31.474728+0000","last_clean":"2024-09-22T03:17:31.474728+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:17:31.474728+0000","last_undegraded":"2024-09-22T03:17:31.474728+0000","last_fullsized":"2024-09-22T03:17:31.474728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":286,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.492577+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:17:06.492577+0000","last_peered":"2024-09-22T03:17:06.492577+0000","last_clean":"2024-09-22T03:17:06.492577+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:17:06.492577+0000","last_undegraded":"2024-09-22T03:17:06.492577+0000","last_fullsized":"2024-09-22T03:17:06.492577+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"63'479","reported_seq":495,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.623024+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:17:31.623024+0000","last_peered":"2024-09-22T03:17:31.623024+0000","last_clean":"2024-09-22T03:17:31.623024+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:17:31.623024+0000","last_undegraded":"2024-09-22T03:17:31.623024+0000","last_fullsized":"2024-09-22T03:17:31.623024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":163,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.491778+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:17:31.491778+0000","last_peered":"2024-09-22T03:17:31.491778+0000","last_clean":"2024-09-22T03:17:31.491778+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:17:31.491778+0000","last_undegraded":"2024-09-22T03:17:31.491778+0000","last_fullsized":"2024-09-22T03:17:31.491778+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"62'503","reported_seq":516,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.204014+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:17:30.204014+0000","last_peered":"2024-09-22T03:17:30.204014+0000","last_clean":"2024-09-22T03:17:30.204014+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:17:30.204014+0000","last_undegraded":"2024-09-22T03:17:30.204014+0000","last_fullsized":"2024-09-22T03:17:30.204014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":163,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.475942+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:17:31.475942+0000","last_peered":"2024-09-22T03:17:31.475942+0000","last_clean":"2024-09-22T03:17:31.475942+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:17:31.475942+0000","last_undegraded":"2024-09-22T03:17:31.475942+0000","last_fullsized":"2024-09-22T03:17:31.475942+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"62'559","reported_seq":572,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.715684+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:17:30.715684+0000","last_peered":"2024-09-22T03:17:30.715684+0000","last_clean":"2024-09-22T03:17:30.715684+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:17:30.715684+0000","last_undegraded":"2024-09-22T03:17:30.715684+0000","last_fullsized":"2024-09-22T03:17:30.715684+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":163,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.499456+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:17:31.499456+0000","last_peered":"2024-09-22T03:17:31.499456+0000","last_clean":"2024-09-22T03:17:31.499456+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:17:31.499456+0000","last_undegraded":"2024-09-22T03:17:31.499456+0000","last_fullsized":"2024-09-22T03:17:31.499456+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"62'575","reported_seq":588,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.652030+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:17:30.652030+0000","last_peered":"2024-09-22T03:17:30.652030+0000","last_clean":"2024-09-22T03:17:30.652030+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:17:30.652030+0000","last_undegraded":"2024-09-22T03:17:30.652030+0000","last_fullsized":"2024-09-22T03:17:30.652030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":163,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.497935+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:17:31.497935+0000","last_peered":"2024-09-22T03:17:31.497935+0000","last_clean":"2024-09-22T03:17:31.497935+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:17:31.497935+0000","last_undegraded":"2024-09-22T03:17:31.497935+0000","last_fullsized":"2024-09-22T03:17:31.497935+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":68386816,"num_objects":1045,"num_object_clones":0,"num_object_copies":3135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8348,"num_write_kb":66784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":103149568,"data_stored":206299136,"data_compressed":10649079,"data_compressed_allocated":103149568,"data_compressed_original":206299136,"omap_allocated":0,"internal_metadata":0},"log_size":8335,"ondisk_log_size":8335,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":147376,"kb_used_data":19744,"kb_used_omap":0,"kb_used_meta":127616,"kb_avail":94224464,"statfs":{"total":96636764160,"available":96485851136,"internally_reserved":0,"allocated":20217856,"data_stored":39529082,"data_compressed":2030145,"data_compressed_allocated":19664896,"data_compressed_original":39329792,"omap_allocated":0,"internal_metadata":130678784},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117484,"kb_used_data":30684,"kb_used_omap":0,"kb_used_meta":86784,"kb_avail":94254356,"statfs":{"total":96636764160,"available":96516460544,"internally_reserved":0,"allocated":31420416,"data_stored":62401690,"data_compressed":3210409,"data_compressed_allocated":30846976,"data_compressed_original":62185472,"omap_allocated":0,"internal_metadata":88866816},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133260,"kb_used_data":24700,"kb_used_omap":0,"kb_used_meta":108544,"kb_avail":94238580,"statfs":{"total":96636764160,"available":96500305920,"internally_reserved":0,"allocated":25292800,"data_stored":50159569,"data_compressed":2578565,"data_compressed_allocated":24727552,"data_compressed_original":49946624,"omap_allocated":0,"internal_metadata":111149056},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135480,"kb_used_data":26984,"kb_used_omap":0,"kb_used_meta":108480,"kb_avail":94236360,"statfs":{"total":96636764160,"available":96498032640,"internally_reserved":0,"allocated":27631616,"data_stored":54845374,"data_compressed":2820435,"data_compressed_allocated":27070464,"data_compressed_original":54632448,"omap_allocated":0,"internal_metadata":111083520},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27279360,"data_stored":54558720,"data_compressed":2816278,"data_compressed_allocated":27279360,"data_compressed_original":54558720,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24985600,"data_stored":49971200,"data_compressed":2579484,"data_compressed_allocated":24985600,"data_compressed_original":49971200,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31113216,"data_stored":62226432,"data_compressed":3212174,"data_compressed_allocated":31113216,"data_compressed_original":62226432,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19771392,"data_stored":39542784,"data_compressed":2041143,"data_compressed_allocated":19771392,"data_compressed_original":39542784,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:17:34.908 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:17:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:35.054+0000 7efc5ff57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:35.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:35.065+0000 7efc5ff57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:35.199 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:17:35.301 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:17:35.319 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":458,"stamp":"2024-09-22T03:17:34.831502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68977203,"num_objects":1049,"num_object_clones":0,"num_object_copies":3147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":8487,"num_write_kb":68680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8435,"ondisk_log_size":8435,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":533600,"kb_used_data":102112,"kb_used_omap":0,"kb_used_meta":431424,"kb_avail":376953760,"statfs":{"total":386547056640,"available":386000650240,"internally_reserved":0,"allocated":104562688,"data_stored":206935715,"data_compressed":10639554,"data_compressed_allocated":102309888,"data_compressed_original":206094336,"omap_allocated":0,"internal_metadata":441778176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6774784,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":6616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000658"},"pg_stats":[{"pgid":"10.7","version":"62'607","reported_seq":620,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.451006+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:17:30.451006+0000","last_peered":"2024-09-22T03:17:30.451006+0000","last_clean":"2024-09-22T03:17:30.451006+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:17:30.451006+0000","last_undegraded":"2024-09-22T03:17:30.451006+0000","last_fullsized":"2024-09-22T03:17:30.451006+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"63'559","reported_seq":575,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.764513+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:17:31.764513+0000","last_peered":"2024-09-22T03:17:31.764513+0000","last_clean":"2024-09-22T03:17:31.764513+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:17:31.764513+0000","last_undegraded":"2024-09-22T03:17:31.764513+0000","last_fullsized":"2024-09-22T03:17:31.764513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"63'492","reported_seq":508,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.756745+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:17:31.756745+0000","last_peered":"2024-09-22T03:17:31.756745+0000","last_clean":"2024-09-22T03:17:31.756745+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:17:31.756745+0000","last_undegraded":"2024-09-22T03:17:31.756745+0000","last_fullsized":"2024-09-22T03:17:31.756745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4038656,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":493,"num_write_kb":3944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"62'568","reported_seq":583,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.474134+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:17:31.474134+0000","last_peered":"2024-09-22T03:17:31.474134+0000","last_clean":"2024-09-22T03:17:31.474134+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:17:31.474134+0000","last_undegraded":"2024-09-22T03:17:31.474134+0000","last_fullsized":"2024-09-22T03:17:31.474134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"62'591","reported_seq":604,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.601060+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:17:30.601060+0000","last_peered":"2024-09-22T03:17:30.601060+0000","last_clean":"2024-09-22T03:17:30.601060+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:17:30.601060+0000","last_undegraded":"2024-09-22T03:17:30.601060+0000","last_fullsized":"2024-09-22T03:17:30.601060+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"62'440","reported_seq":455,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.471051+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:17:31.471051+0000","last_peered":"2024-09-22T03:17:31.471051+0000","last_clean":"2024-09-22T03:17:31.471051+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:17:31.471051+0000","last_undegraded":"2024-09-22T03:17:31.471051+0000","last_fullsized":"2024-09-22T03:17:31.471051+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"62'443","reported_seq":456,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.785297+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:17:30.785297+0000","last_peered":"2024-09-22T03:17:30.785297+0000","last_clean":"2024-09-22T03:17:30.785297+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:17:30.785297+0000","last_undegraded":"2024-09-22T03:17:30.785297+0000","last_fullsized":"2024-09-22T03:17:30.785297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3637248,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":3552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"63'503","reported_seq":519,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.713918+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:17:31.713918+0000","last_peered":"2024-09-22T03:17:31.713918+0000","last_clean":"2024-09-22T03:17:31.713918+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:17:31.713918+0000","last_undegraded":"2024-09-22T03:17:31.713918+0000","last_fullsized":"2024-09-22T03:17:31.713918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"63'519","reported_seq":535,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.557570+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:17:31.557570+0000","last_peered":"2024-09-22T03:17:31.557570+0000","last_clean":"2024-09-22T03:17:31.557570+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:17:31.557570+0000","last_undegraded":"2024-09-22T03:17:31.557570+0000","last_fullsized":"2024-09-22T03:17:31.557570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":163,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.471956+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:17:31.471956+0000","last_peered":"2024-09-22T03:17:31.471956+0000","last_clean":"2024-09-22T03:17:31.471956+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:17:31.471956+0000","last_undegraded":"2024-09-22T03:17:31.471956+0000","last_fullsized":"2024-09-22T03:17:31.471956+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"62'511","reported_seq":524,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:29.560429+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:17:29.560429+0000","last_peered":"2024-09-22T03:17:29.560429+0000","last_clean":"2024-09-22T03:17:29.560429+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:17:29.560429+0000","last_undegraded":"2024-09-22T03:17:29.560429+0000","last_fullsized":"2024-09-22T03:17:29.560429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.484350+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:17:06.484350+0000","last_peered":"2024-09-22T03:17:06.484350+0000","last_clean":"2024-09-22T03:17:06.484350+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:17:06.484350+0000","last_undegraded":"2024-09-22T03:17:06.484350+0000","last_fullsized":"2024-09-22T03:17:06.484350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"63'434","reported_seq":450,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.799253+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:17:31.799253+0000","last_peered":"2024-09-22T03:17:31.799253+0000","last_clean":"2024-09-22T03:17:31.799253+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:17:31.799253+0000","last_undegraded":"2024-09-22T03:17:31.799253+0000","last_fullsized":"2024-09-22T03:17:31.799253+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563520,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":165,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.471487+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:17:31.471487+0000","last_peered":"2024-09-22T03:17:31.471487+0000","last_clean":"2024-09-22T03:17:31.471487+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:17:31.471487+0000","last_undegraded":"2024-09-22T03:17:31.471487+0000","last_fullsized":"2024-09-22T03:17:31.471487+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"62'552","reported_seq":567,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.473619+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:17:31.473619+0000","last_peered":"2024-09-22T03:17:31.473619+0000","last_clean":"2024-09-22T03:17:31.473619+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:17:31.473619+0000","last_undegraded":"2024-09-22T03:17:31.473619+0000","last_fullsized":"2024-09-22T03:17:31.473619+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":164,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.474728+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:17:31.474728+0000","last_peered":"2024-09-22T03:17:31.474728+0000","last_clean":"2024-09-22T03:17:31.474728+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:17:31.474728+0000","last_undegraded":"2024-09-22T03:17:31.474728+0000","last_fullsized":"2024-09-22T03:17:31.474728+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":286,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:06.492577+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:17:06.492577+0000","last_peered":"2024-09-22T03:17:06.492577+0000","last_clean":"2024-09-22T03:17:06.492577+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:17:06.492577+0000","last_undegraded":"2024-09-22T03:17:06.492577+0000","last_fullsized":"2024-09-22T03:17:06.492577+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"63'479","reported_seq":495,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.623024+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:17:31.623024+0000","last_peered":"2024-09-22T03:17:31.623024+0000","last_clean":"2024-09-22T03:17:31.623024+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:17:31.623024+0000","last_undegraded":"2024-09-22T03:17:31.623024+0000","last_fullsized":"2024-09-22T03:17:31.623024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":163,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.491778+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:17:31.491778+0000","last_peered":"2024-09-22T03:17:31.491778+0000","last_clean":"2024-09-22T03:17:31.491778+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:17:31.491778+0000","last_undegraded":"2024-09-22T03:17:31.491778+0000","last_fullsized":"2024-09-22T03:17:31.491778+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"62'503","reported_seq":516,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.204014+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:17:30.204014+0000","last_peered":"2024-09-22T03:17:30.204014+0000","last_clean":"2024-09-22T03:17:30.204014+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:17:30.204014+0000","last_undegraded":"2024-09-22T03:17:30.204014+0000","last_fullsized":"2024-09-22T03:17:30.204014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":163,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.475942+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:17:31.475942+0000","last_peered":"2024-09-22T03:17:31.475942+0000","last_clean":"2024-09-22T03:17:31.475942+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:17:31.475942+0000","last_undegraded":"2024-09-22T03:17:31.475942+0000","last_fullsized":"2024-09-22T03:17:31.475942+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"62'559","reported_seq":572,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.715684+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:17:30.715684+0000","last_peered":"2024-09-22T03:17:30.715684+0000","last_clean":"2024-09-22T03:17:30.715684+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:17:30.715684+0000","last_undegraded":"2024-09-22T03:17:30.715684+0000","last_fullsized":"2024-09-22T03:17:30.715684+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":163,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.499456+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:17:31.499456+0000","last_peered":"2024-09-22T03:17:31.499456+0000","last_clean":"2024-09-22T03:17:31.499456+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:17:31.499456+0000","last_undegraded":"2024-09-22T03:17:31.499456+0000","last_fullsized":"2024-09-22T03:17:31.499456+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"62'575","reported_seq":588,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-22T03:17:30.652030+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:17:30.652030+0000","last_peered":"2024-09-22T03:17:30.652030+0000","last_clean":"2024-09-22T03:17:30.652030+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:17:30.652030+0000","last_undegraded":"2024-09-22T03:17:30.652030+0000","last_fullsized":"2024-09-22T03:17:30.652030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":163,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-22T03:17:31.497935+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:17:31.497935+0000","last_peered":"2024-09-22T03:17:31.497935+0000","last_clean":"2024-09-22T03:17:31.497935+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:17:31.497935+0000","last_undegraded":"2024-09-22T03:17:31.497935+0000","last_fullsized":"2024-09-22T03:17:31.497935+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":68386816,"num_objects":1045,"num_object_clones":0,"num_object_copies":3135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8348,"num_write_kb":66784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":103149568,"data_stored":206299136,"data_compressed":10649079,"data_compressed_allocated":103149568,"data_compressed_original":206299136,"omap_allocated":0,"internal_metadata":0},"log_size":8335,"ondisk_log_size":8335,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":147376,"kb_used_data":19744,"kb_used_omap":0,"kb_used_meta":127616,"kb_avail":94224464,"statfs":{"total":96636764160,"available":96485851136,"internally_reserved":0,"allocated":20217856,"data_stored":39529082,"data_compressed":2030145,"data_compressed_allocated":19664896,"data_compressed_original":39329792,"omap_allocated":0,"internal_metadata":130678784},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117484,"kb_used_data":30684,"kb_used_omap":0,"kb_used_meta":86784,"kb_avail":94254356,"statfs":{"total":96636764160,"available":96516460544,"internally_reserved":0,"allocated":31420416,"data_stored":62401690,"data_compressed":3210409,"data_compressed_allocated":30846976,"data_compressed_original":62185472,"omap_allocated":0,"internal_metadata":88866816},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133260,"kb_used_data":24700,"kb_used_omap":0,"kb_used_meta":108544,"kb_avail":94238580,"statfs":{"total":96636764160,"available":96500305920,"internally_reserved":0,"allocated":25292800,"data_stored":50159569,"data_compressed":2578565,"data_compressed_allocated":24727552,"data_compressed_original":49946624,"omap_allocated":0,"internal_metadata":111149056},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135480,"kb_used_data":26984,"kb_used_omap":0,"kb_used_meta":108480,"kb_avail":94236360,"statfs":{"total":96636764160,"available":96498032640,"internally_reserved":0,"allocated":27631616,"data_stored":54845374,"data_compressed":2820435,"data_compressed_allocated":27070464,"data_compressed_original":54632448,"omap_allocated":0,"internal_metadata":111083520},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27279360,"data_stored":54558720,"data_compressed":2816278,"data_compressed_allocated":27279360,"data_compressed_original":54558720,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24985600,"data_stored":49971200,"data_compressed":2579484,"data_compressed_allocated":24985600,"data_compressed_original":49971200,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31113216,"data_stored":62226432,"data_compressed":3212174,"data_compressed_allocated":31113216,"data_compressed_original":62226432,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19771392,"data_stored":39542784,"data_compressed":2041143,"data_compressed_allocated":19771392,"data_compressed_original":39542784,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:17:35.320 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:17:35.320 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:17:35.320 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:17:35.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:17:35.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:35.351+0000 7f51fb0fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:35.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:35.361+0000 7f51fb0fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:35.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:35.480+0000 7f13e4f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:35.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:35.492+0000 7f13e4f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:35.545 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:35.545 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:35.545 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:35.545 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:35.545 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:35.546 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:35.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:17:35.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 29 16 9609 9593 2.58411 2.3125 0.0200014 0.0483162 2024-09-22T03:17:35.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:35.703+0000 7ff13f917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:35.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:35.717+0000 7ff13f917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:35.755 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:35.755 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:35.755 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:35.755 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:35.755 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:35.755 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:35.755 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:35.755 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:35.755 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:35.755 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:35.755 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:35.756 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:35.759 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:35.759 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:35.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:17:35.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:35.900+0000 7fc907eb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:35.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:35.911+0000 7fc907eb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:35.949 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:35.949 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:35.950 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:35.950 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:35.950 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:35.950 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:35.950 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:35.950 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:35.950 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:35.950 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:35.950 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:35.950 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:35.954 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:35.954 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:35.955 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:17:36.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:36.103+0000 7fcecfd17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:36.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:36.115+0000 7fcecfd17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:36.159 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:36.159 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:36.162 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:36.162 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:36.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 30 16 9939 9923 2.58391 2.57812 0.036219 0.0483303 2024-09-22T03:17:37.545 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:37.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 31 16 10246 10230 2.57792 2.39844 0.0306504 0.0484198 2024-09-22T03:17:37.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:37.686+0000 7f6806a58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:37.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:37.697+0000 7f6806a58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:38.567 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 32 16 10530 10514 2.56669 2.21875 0.0764724 0.0486389 2024-09-22T03:17:39.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 33 16 10859 10843 2.5668 2.57031 0.0233497 0.0486454 2024-09-22T03:17:39.953 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:40.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:40.087+0000 7f8792957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:40.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:40.092+0000 7f8792957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:40.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 34 16 11163 11147 2.56114 2.375 0.0176506 0.0487317 2024-09-22T03:17:41.163 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:17:41.163 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:17:41.163 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:17:41.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:17:41.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:41.281+0000 7f67c184f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:41.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:41.292+0000 7f67c184f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:41.343 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:41.344 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:41.344 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:41.344 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:41.344 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:41.344 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:41.344 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:41.344 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:41.344 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:41.344 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:41.344 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:41.344 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:41.347 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:41.347 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:41.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:17:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:41.467+0000 7f4cc1f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:41.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:41.477+0000 7f4cc1f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:41.522 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:41.523 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:41.523 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:41.523 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:41.523 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:41.523 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:41.523 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:41.523 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:41.523 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:41.523 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:41.523 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:41.523 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:41.526 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:41.527 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:41.527 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:17:41.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 35 16 11451 11435 2.55225 2.25 0.0242472 0.0489357 2024-09-22T03:17:41.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:41.650+0000 7fc01b597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:41.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:41.660+0000 7fc01b597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:41.681 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:41.681 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:41.681 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:41.681 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:41.681 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:41.681 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:41.681 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:41.681 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:41.681 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:41.682 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:41.682 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:41.682 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:41.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:41.684 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:41.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:17:41.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:41.835+0000 7f43f9597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:41.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:41.844+0000 7f43f9597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:41.859 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:17:41.859 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:17:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:17:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:17:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:17:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:17:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:17:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:17:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:17:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:17:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:17:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:17:41.863 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:17:41.863 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:17:42.237 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:42.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:42.355+0000 7f4c72197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:42.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:42.361+0000 7f4c72197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:42.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 36 16 11729 11713 2.54168 2.17188 0.0699149 0.0491128 2024-09-22T03:17:43.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 37 16 12031 12015 2.53675 2.35938 0.0847627 0.0492273 2024-09-22T03:17:44.522 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:44.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 38 16 12314 12298 2.52817 2.21094 0.069964 0.0494045 2024-09-22T03:17:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:44.636+0000 7f94a2797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:44.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:44.642+0000 7f94a2797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:45.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 39 16 12610 12594 2.52263 2.3125 0.0544216 0.0494919 2024-09-22T03:17:46.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:17:46.567751+0000 min lat: 0.00903376 max lat: 0.162989 avg lat: 0.0495842 2024-09-22T03:17:46.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:17:46.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 40 16 12915 12899 2.51913 2.38281 0.0554971 0.0495842 2024-09-22T03:17:46.842 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:46.864 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:17:46.864 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:17:46.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:17:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:46.988+0000 7f8f14b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:46.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:46.997+0000 7f8f14b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:47.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:47.007+0000 7f3556197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:47.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:47.017+0000 7f3554f35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:47.278 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:17:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:17:47.299 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":466,"stamp":"2024-09-22T03:17:46.833821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":106070579,"num_objects":1614,"num_object_clones":0,"num_object_copies":4842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":13015,"num_write_kb":104904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12960,"ondisk_log_size":12960,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":588992,"kb_used_data":156096,"kb_used_omap":0,"kb_used_meta":432832,"kb_avail":376898368,"statfs":{"total":386547056640,"available":385943928832,"internally_reserved":0,"allocated":159842304,"data_stored":317206441,"data_compressed":16329747,"data_compressed_allocated":157409280,"data_compressed_original":316293120,"omap_allocated":0,"internal_metadata":443219968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24731648,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3019,"num_write_kb":24152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.373704"},"pg_stats":[{"pgid":"10.7","version":"68'895","reported_seq":926,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:45.672190+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:17:45.672190+0000","last_peered":"2024-09-22T03:17:45.672190+0000","last_clean":"2024-09-22T03:17:45.672190+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:17:45.672190+0000","last_undegraded":"2024-09-22T03:17:45.672190+0000","last_fullsized":"2024-09-22T03:17:45.672190+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"68'783","reported_seq":814,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.507029+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:17:46.507029+0000","last_peered":"2024-09-22T03:17:46.507029+0000","last_clean":"2024-09-22T03:17:46.507029+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:17:46.507029+0000","last_undegraded":"2024-09-22T03:17:46.507029+0000","last_fullsized":"2024-09-22T03:17:46.507029+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"68'887","reported_seq":918,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.757824+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:17:46.757824+0000","last_peered":"2024-09-22T03:17:46.757824+0000","last_clean":"2024-09-22T03:17:46.757824+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:17:46.757824+0000","last_undegraded":"2024-09-22T03:17:46.757824+0000","last_fullsized":"2024-09-22T03:17:46.757824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"68'879","reported_seq":910,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.073498+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:17:46.073498+0000","last_peered":"2024-09-22T03:17:46.073498+0000","last_clean":"2024-09-22T03:17:46.073498+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:17:46.073498+0000","last_undegraded":"2024-09-22T03:17:46.073498+0000","last_fullsized":"2024-09-22T03:17:46.073498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"68'879","reported_seq":910,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:45.549244+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:17:45.549244+0000","last_peered":"2024-09-22T03:17:45.549244+0000","last_clean":"2024-09-22T03:17:45.549244+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:17:45.549244+0000","last_undegraded":"2024-09-22T03:17:45.549244+0000","last_fullsized":"2024-09-22T03:17:45.549244+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"68'743","reported_seq":774,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.707706+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:17:46.707706+0000","last_peered":"2024-09-22T03:17:46.707706+0000","last_clean":"2024-09-22T03:17:46.707706+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:17:46.707706+0000","last_undegraded":"2024-09-22T03:17:46.707706+0000","last_fullsized":"2024-09-22T03:17:46.707706+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"68'639","reported_seq":670,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:45.779495+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:17:45.779495+0000","last_peered":"2024-09-22T03:17:45.779495+0000","last_clean":"2024-09-22T03:17:45.779495+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:17:45.779495+0000","last_undegraded":"2024-09-22T03:17:45.779495+0000","last_fullsized":"2024-09-22T03:17:45.779495+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"68'767","reported_seq":798,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.334772+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:17:46.334772+0000","last_peered":"2024-09-22T03:17:46.334772+0000","last_clean":"2024-09-22T03:17:46.334772+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:17:46.334772+0000","last_undegraded":"2024-09-22T03:17:46.334772+0000","last_fullsized":"2024-09-22T03:17:46.334772+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"68'783","reported_seq":814,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:45.613993+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:17:45.613993+0000","last_peered":"2024-09-22T03:17:45.613993+0000","last_clean":"2024-09-22T03:17:45.613993+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:17:45.613993+0000","last_undegraded":"2024-09-22T03:17:45.613993+0000","last_fullsized":"2024-09-22T03:17:45.613993+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":178,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.469559+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:17:43.469559+0000","last_peered":"2024-09-22T03:17:43.469559+0000","last_clean":"2024-09-22T03:17:43.469559+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:17:43.469559+0000","last_undegraded":"2024-09-22T03:17:43.469559+0000","last_fullsized":"2024-09-22T03:17:43.469559+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"68'735","reported_seq":766,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:45.652878+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:17:45.652878+0000","last_peered":"2024-09-22T03:17:45.652878+0000","last_clean":"2024-09-22T03:17:45.652878+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:17:45.652878+0000","last_undegraded":"2024-09-22T03:17:45.652878+0000","last_fullsized":"2024-09-22T03:17:45.652878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":178,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.478018+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:17:43.478018+0000","last_peered":"2024-09-22T03:17:43.478018+0000","last_clean":"2024-09-22T03:17:43.478018+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:17:43.478018+0000","last_undegraded":"2024-09-22T03:17:43.478018+0000","last_fullsized":"2024-09-22T03:17:43.478018+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"68'719","reported_seq":750,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.611302+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:17:46.611302+0000","last_peered":"2024-09-22T03:17:46.611302+0000","last_clean":"2024-09-22T03:17:46.611302+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:17:46.611302+0000","last_undegraded":"2024-09-22T03:17:46.611302+0000","last_fullsized":"2024-09-22T03:17:46.611302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":180,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.470271+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:17:43.470271+0000","last_peered":"2024-09-22T03:17:43.470271+0000","last_clean":"2024-09-22T03:17:43.470271+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:17:43.470271+0000","last_undegraded":"2024-09-22T03:17:43.470271+0000","last_fullsized":"2024-09-22T03:17:43.470271+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"68'847","reported_seq":878,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.435154+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:17:46.435154+0000","last_peered":"2024-09-22T03:17:46.435154+0000","last_clean":"2024-09-22T03:17:46.435154+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:17:46.435154+0000","last_undegraded":"2024-09-22T03:17:46.435154+0000","last_fullsized":"2024-09-22T03:17:46.435154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":179,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.471542+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:17:43.471542+0000","last_peered":"2024-09-22T03:17:43.471542+0000","last_clean":"2024-09-22T03:17:43.471542+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:17:43.471542+0000","last_undegraded":"2024-09-22T03:17:43.471542+0000","last_fullsized":"2024-09-22T03:17:43.471542+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":304,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.480150+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:17:43.480150+0000","last_peered":"2024-09-22T03:17:43.480150+0000","last_clean":"2024-09-22T03:17:43.480150+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:17:43.480150+0000","last_undegraded":"2024-09-22T03:17:43.480150+0000","last_fullsized":"2024-09-22T03:17:43.480150+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"68'807","reported_seq":838,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.136379+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:17:46.136379+0000","last_peered":"2024-09-22T03:17:46.136379+0000","last_clean":"2024-09-22T03:17:46.136379+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:17:46.136379+0000","last_undegraded":"2024-09-22T03:17:46.136379+0000","last_fullsized":"2024-09-22T03:17:46.136379+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":178,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.492941+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:17:43.492941+0000","last_peered":"2024-09-22T03:17:43.492941+0000","last_clean":"2024-09-22T03:17:43.492941+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:17:43.492941+0000","last_undegraded":"2024-09-22T03:17:43.492941+0000","last_fullsized":"2024-09-22T03:17:43.492941+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"68'867","reported_seq":898,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:45.791566+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:17:45.791566+0000","last_peered":"2024-09-22T03:17:45.791566+0000","last_clean":"2024-09-22T03:17:45.791566+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:17:45.791566+0000","last_undegraded":"2024-09-22T03:17:45.791566+0000","last_fullsized":"2024-09-22T03:17:45.791566+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7110656,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":868,"num_write_kb":6944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":178,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.473647+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:17:43.473647+0000","last_peered":"2024-09-22T03:17:43.473647+0000","last_clean":"2024-09-22T03:17:43.473647+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:17:43.473647+0000","last_undegraded":"2024-09-22T03:17:43.473647+0000","last_fullsized":"2024-09-22T03:17:43.473647+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"68'783","reported_seq":814,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:44.730212+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:17:44.730212+0000","last_peered":"2024-09-22T03:17:44.730212+0000","last_clean":"2024-09-22T03:17:44.730212+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:17:44.730212+0000","last_undegraded":"2024-09-22T03:17:44.730212+0000","last_fullsized":"2024-09-22T03:17:44.730212+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":178,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.496041+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:17:43.496041+0000","last_peered":"2024-09-22T03:17:43.496041+0000","last_clean":"2024-09-22T03:17:43.496041+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:17:43.496041+0000","last_undegraded":"2024-09-22T03:17:43.496041+0000","last_fullsized":"2024-09-22T03:17:43.496041+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"68'847","reported_seq":878,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:45.552485+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:17:45.552485+0000","last_peered":"2024-09-22T03:17:45.552485+0000","last_clean":"2024-09-22T03:17:45.552485+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:17:45.552485+0000","last_undegraded":"2024-09-22T03:17:45.552485+0000","last_fullsized":"2024-09-22T03:17:45.552485+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":178,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.497992+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:17:43.497992+0000","last_peered":"2024-09-22T03:17:43.497992+0000","last_clean":"2024-09-22T03:17:43.497992+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:17:43.497992+0000","last_undegraded":"2024-09-22T03:17:43.497992+0000","last_fullsized":"2024-09-22T03:17:43.497992+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":105480192,"num_objects":1610,"num_object_clones":0,"num_object_copies":4830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12876,"num_write_kb":103008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":158294016,"data_stored":316588032,"data_compressed":16343925,"data_compressed_allocated":158294016,"data_compressed_original":316588032,"omap_allocated":0,"internal_metadata":0},"log_size":12860,"ondisk_log_size":12860,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149772,"kb_used_data":30460,"kb_used_omap":0,"kb_used_meta":119296,"kb_avail":94222068,"statfs":{"total":96636764160,"available":96483397632,"internally_reserved":0,"allocated":31191040,"data_stored":61409879,"data_compressed":3159131,"data_compressed_allocated":30597120,"data_compressed_original":61194240,"omap_allocated":0,"internal_metadata":122159104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133212,"kb_used_data":46412,"kb_used_omap":0,"kb_used_meta":86784,"kb_avail":94238628,"statfs":{"total":96636764160,"available":96500355072,"internally_reserved":0,"allocated":47525888,"data_stored":94547063,"data_compressed":4869414,"data_compressed_allocated":46911488,"data_compressed_original":94314496,"omap_allocated":0,"internal_metadata":88866816},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142588,"kb_used_data":38188,"kb_used_omap":0,"kb_used_meta":104384,"kb_avail":94229252,"statfs":{"total":96636764160,"available":96490754048,"internally_reserved":0,"allocated":39104512,"data_stored":77704311,"data_compressed":3999844,"data_compressed_allocated":38490112,"data_compressed_original":77471744,"omap_allocated":0,"internal_metadata":106889216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":163420,"kb_used_data":41036,"kb_used_omap":0,"kb_used_meta":122368,"kb_avail":94208420,"statfs":{"total":96636764160,"available":96469422080,"internally_reserved":0,"allocated":42020864,"data_stored":83545188,"data_compressed":4301358,"data_compressed_allocated":41410560,"data_compressed_original":83312640,"omap_allocated":0,"internal_metadata":125304832},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41598976,"data_stored":83197952,"data_compressed":4295086,"data_compressed_allocated":41598976,"data_compressed_original":83197952,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38727680,"data_stored":77455360,"data_compressed":3998648,"data_compressed_allocated":38727680,"data_compressed_original":77455360,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47128576,"data_stored":94257152,"data_compressed":4866103,"data_compressed_allocated":47128576,"data_compressed_original":94257152,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30838784,"data_stored":61677568,"data_compressed":3184088,"data_compressed_allocated":30838784,"data_compressed_original":61677568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:17:47.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 41 16 13178 13162 2.5078 2.05469 0.0680575 0.0498006 2024-09-22T03:17:48.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 42 16 13441 13425 2.49701 2.05469 0.053431 0.049968 2024-09-22T03:17:49.239 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:49.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:49.394+0000 7f3365397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:49.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:49.401+0000 7f3365397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:49.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 43 16 13696 13680 2.48527 1.99219 0.162238 0.0502287 2024-09-22T03:17:50.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 44 16 13983 13967 2.47974 2.24219 0.0471472 0.0503528 2024-09-22T03:17:51.525 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:51.568 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 45 16 14282 14266 2.47654 2.33594 0.0207841 0.0504309 2024-09-22T03:17:51.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:51.671+0000 7f281e597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:51.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:51.677+0000 7f281e597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:52.301 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:17:52.302 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:17:52.302 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:17:52.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:52.427+0000 7fca28997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:52.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:52.438+0000 7fca28997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:52.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 46 16 14565 14549 2.47076 2.21094 0.0511745 0.0505283 2024-09-22T03:17:52.716 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:17:52.717 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:17:52.735 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":469,"stamp":"2024-09-22T03:17:50.834631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":110830131,"num_objects":1687,"num_object_clones":0,"num_object_copies":5061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":13596,"num_write_kb":109552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13541,"ondisk_log_size":13541,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":597880,"kb_used_data":160824,"kb_used_omap":0,"kb_used_meta":436992,"kb_avail":376889480,"statfs":{"total":386547056640,"available":385934827520,"internally_reserved":0,"allocated":164683776,"data_stored":326876266,"data_compressed":16828887,"data_compressed_allocated":162242560,"data_compressed_original":325959680,"omap_allocated":0,"internal_metadata":447479808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16850944,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2057,"num_write_kb":16456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001587"},"pg_stats":[{"pgid":"10.7","version":"69'999","reported_seq":1033,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-22T03:17:50.516278+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:17:50.516278+0000","last_peered":"2024-09-22T03:17:50.516278+0000","last_clean":"2024-09-22T03:17:50.516278+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:17:50.516278+0000","last_undegraded":"2024-09-22T03:17:50.516278+0000","last_fullsized":"2024-09-22T03:17:50.516278+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1000,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"68'783","reported_seq":814,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.507029+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:17:46.507029+0000","last_peered":"2024-09-22T03:17:46.507029+0000","last_clean":"2024-09-22T03:17:46.507029+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:17:46.507029+0000","last_undegraded":"2024-09-22T03:17:46.507029+0000","last_fullsized":"2024-09-22T03:17:46.507029+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"68'887","reported_seq":918,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.757824+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:17:46.757824+0000","last_peered":"2024-09-22T03:17:46.757824+0000","last_clean":"2024-09-22T03:17:46.757824+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:17:46.757824+0000","last_undegraded":"2024-09-22T03:17:46.757824+0000","last_fullsized":"2024-09-22T03:17:46.757824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"68'879","reported_seq":910,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.073498+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:17:46.073498+0000","last_peered":"2024-09-22T03:17:46.073498+0000","last_clean":"2024-09-22T03:17:46.073498+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:17:46.073498+0000","last_undegraded":"2024-09-22T03:17:46.073498+0000","last_fullsized":"2024-09-22T03:17:46.073498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"69'935","reported_seq":969,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-22T03:17:50.304159+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:17:50.304159+0000","last_peered":"2024-09-22T03:17:50.304159+0000","last_clean":"2024-09-22T03:17:50.304159+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:17:50.304159+0000","last_undegraded":"2024-09-22T03:17:50.304159+0000","last_fullsized":"2024-09-22T03:17:50.304159+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"68'743","reported_seq":774,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.707706+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:17:46.707706+0000","last_peered":"2024-09-22T03:17:46.707706+0000","last_clean":"2024-09-22T03:17:46.707706+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:17:46.707706+0000","last_undegraded":"2024-09-22T03:17:46.707706+0000","last_fullsized":"2024-09-22T03:17:46.707706+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"69'703","reported_seq":737,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-22T03:17:50.393470+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:17:50.393470+0000","last_peered":"2024-09-22T03:17:50.393470+0000","last_clean":"2024-09-22T03:17:50.393470+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:17:50.393470+0000","last_undegraded":"2024-09-22T03:17:50.393470+0000","last_fullsized":"2024-09-22T03:17:50.393470+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"68'767","reported_seq":798,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.334772+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:17:46.334772+0000","last_peered":"2024-09-22T03:17:46.334772+0000","last_clean":"2024-09-22T03:17:46.334772+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:17:46.334772+0000","last_undegraded":"2024-09-22T03:17:46.334772+0000","last_fullsized":"2024-09-22T03:17:46.334772+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"68'783","reported_seq":814,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:45.613993+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:17:45.613993+0000","last_peered":"2024-09-22T03:17:45.613993+0000","last_clean":"2024-09-22T03:17:45.613993+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:17:45.613993+0000","last_undegraded":"2024-09-22T03:17:45.613993+0000","last_fullsized":"2024-09-22T03:17:45.613993+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":178,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.469559+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:17:43.469559+0000","last_peered":"2024-09-22T03:17:43.469559+0000","last_clean":"2024-09-22T03:17:43.469559+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:17:43.469559+0000","last_undegraded":"2024-09-22T03:17:43.469559+0000","last_fullsized":"2024-09-22T03:17:43.469559+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"69'840","reported_seq":874,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-22T03:17:50.755146+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:17:50.755146+0000","last_peered":"2024-09-22T03:17:50.755146+0000","last_clean":"2024-09-22T03:17:50.755146+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:17:50.755146+0000","last_undegraded":"2024-09-22T03:17:50.755146+0000","last_fullsized":"2024-09-22T03:17:50.755146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6889472,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":6728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":181,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-22T03:17:48.473196+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:17:48.473196+0000","last_peered":"2024-09-22T03:17:48.473196+0000","last_clean":"2024-09-22T03:17:48.473196+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:17:48.473196+0000","last_undegraded":"2024-09-22T03:17:48.473196+0000","last_fullsized":"2024-09-22T03:17:48.473196+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"68'719","reported_seq":750,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.611302+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:17:46.611302+0000","last_peered":"2024-09-22T03:17:46.611302+0000","last_clean":"2024-09-22T03:17:46.611302+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:17:46.611302+0000","last_undegraded":"2024-09-22T03:17:46.611302+0000","last_fullsized":"2024-09-22T03:17:46.611302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":180,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.470271+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:17:43.470271+0000","last_peered":"2024-09-22T03:17:43.470271+0000","last_clean":"2024-09-22T03:17:43.470271+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:17:43.470271+0000","last_undegraded":"2024-09-22T03:17:43.470271+0000","last_fullsized":"2024-09-22T03:17:43.470271+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"68'847","reported_seq":878,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.435154+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:17:46.435154+0000","last_peered":"2024-09-22T03:17:46.435154+0000","last_clean":"2024-09-22T03:17:46.435154+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:17:46.435154+0000","last_undegraded":"2024-09-22T03:17:46.435154+0000","last_fullsized":"2024-09-22T03:17:46.435154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":179,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.471542+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:17:43.471542+0000","last_peered":"2024-09-22T03:17:43.471542+0000","last_clean":"2024-09-22T03:17:43.471542+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:17:43.471542+0000","last_undegraded":"2024-09-22T03:17:43.471542+0000","last_fullsized":"2024-09-22T03:17:43.471542+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":307,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-22T03:17:48.479441+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:17:48.479441+0000","last_peered":"2024-09-22T03:17:48.479441+0000","last_clean":"2024-09-22T03:17:48.479441+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:17:48.479441+0000","last_undegraded":"2024-09-22T03:17:48.479441+0000","last_fullsized":"2024-09-22T03:17:48.479441+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"68'807","reported_seq":838,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:46.136379+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:17:46.136379+0000","last_peered":"2024-09-22T03:17:46.136379+0000","last_clean":"2024-09-22T03:17:46.136379+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:17:46.136379+0000","last_undegraded":"2024-09-22T03:17:46.136379+0000","last_fullsized":"2024-09-22T03:17:46.136379+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":178,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.492941+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:17:43.492941+0000","last_peered":"2024-09-22T03:17:43.492941+0000","last_clean":"2024-09-22T03:17:43.492941+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:17:43.492941+0000","last_undegraded":"2024-09-22T03:17:43.492941+0000","last_fullsized":"2024-09-22T03:17:43.492941+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"69'943","reported_seq":977,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-22T03:17:50.629485+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:17:50.629485+0000","last_peered":"2024-09-22T03:17:50.629485+0000","last_clean":"2024-09-22T03:17:50.629485+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:17:50.629485+0000","last_undegraded":"2024-09-22T03:17:50.629485+0000","last_fullsized":"2024-09-22T03:17:50.629485+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":178,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.473647+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:17:43.473647+0000","last_peered":"2024-09-22T03:17:43.473647+0000","last_clean":"2024-09-22T03:17:43.473647+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:17:43.473647+0000","last_undegraded":"2024-09-22T03:17:43.473647+0000","last_fullsized":"2024-09-22T03:17:43.473647+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"69'871","reported_seq":905,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-22T03:17:50.280236+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:17:50.280236+0000","last_peered":"2024-09-22T03:17:50.280236+0000","last_clean":"2024-09-22T03:17:50.280236+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:17:50.280236+0000","last_undegraded":"2024-09-22T03:17:50.280236+0000","last_fullsized":"2024-09-22T03:17:50.280236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":178,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.496041+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:17:43.496041+0000","last_peered":"2024-09-22T03:17:43.496041+0000","last_clean":"2024-09-22T03:17:43.496041+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:17:43.496041+0000","last_undegraded":"2024-09-22T03:17:43.496041+0000","last_fullsized":"2024-09-22T03:17:43.496041+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"69'935","reported_seq":969,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-22T03:17:50.714438+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:17:50.714438+0000","last_peered":"2024-09-22T03:17:50.714438+0000","last_clean":"2024-09-22T03:17:50.714438+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:17:50.714438+0000","last_undegraded":"2024-09-22T03:17:50.714438+0000","last_fullsized":"2024-09-22T03:17:50.714438+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":178,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:17:43.497992+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:17:43.497992+0000","last_peered":"2024-09-22T03:17:43.497992+0000","last_clean":"2024-09-22T03:17:43.497992+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:17:43.497992+0000","last_undegraded":"2024-09-22T03:17:43.497992+0000","last_fullsized":"2024-09-22T03:17:43.497992+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":110239744,"num_objects":1683,"num_object_clones":0,"num_object_copies":5049,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13457,"num_write_kb":107656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163069952,"data_stored":326139904,"data_compressed":16837143,"data_compressed_allocated":163069952,"data_compressed_original":326139904,"omap_allocated":0,"internal_metadata":0},"log_size":13441,"ondisk_log_size":13441,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149772,"kb_used_data":30460,"kb_used_omap":0,"kb_used_meta":119296,"kb_avail":94222068,"statfs":{"total":96636764160,"available":96483397632,"internally_reserved":0,"allocated":31191040,"data_stored":61409879,"data_compressed":3159131,"data_compressed_allocated":30597120,"data_compressed_original":61194240,"omap_allocated":0,"internal_metadata":122159104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133212,"kb_used_data":46412,"kb_used_omap":0,"kb_used_meta":86784,"kb_avail":94238628,"statfs":{"total":96636764160,"available":96500355072,"internally_reserved":0,"allocated":47525888,"data_stored":94547063,"data_compressed":4869414,"data_compressed_allocated":46911488,"data_compressed_original":94314496,"omap_allocated":0,"internal_metadata":88866816},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142588,"kb_used_data":38188,"kb_used_omap":0,"kb_used_meta":104384,"kb_avail":94229252,"statfs":{"total":96636764160,"available":96490754048,"internally_reserved":0,"allocated":39104512,"data_stored":77704311,"data_compressed":3999844,"data_compressed_allocated":38490112,"data_compressed_original":77471744,"omap_allocated":0,"internal_metadata":106889216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":172308,"kb_used_data":45764,"kb_used_omap":0,"kb_used_meta":126528,"kb_avail":94199532,"statfs":{"total":96636764160,"available":96460320768,"internally_reserved":0,"allocated":46862336,"data_stored":93215013,"data_compressed":4800498,"data_compressed_allocated":46243840,"data_compressed_original":92979200,"omap_allocated":0,"internal_metadata":129564672},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46374912,"data_stored":92749824,"data_compressed":4788304,"data_compressed_allocated":46374912,"data_compressed_original":92749824,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38727680,"data_stored":77455360,"data_compressed":3998648,"data_compressed_allocated":38727680,"data_compressed_original":77455360,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47128576,"data_stored":94257152,"data_compressed":4866103,"data_compressed_allocated":47128576,"data_compressed_original":94257152,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30838784,"data_stored":61677568,"data_compressed":3184088,"data_compressed_allocated":30838784,"data_compressed_original":61677568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:17:53.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 47 16 14844 14828 2.46456 2.17969 0.106088 0.050662 2024-09-22T03:17:53.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:53.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:53.925+0000 7f4abf06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:53.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:53.931+0000 7f4abf06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:54.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 48 16 15112 15096 2.45683 2.09375 0.068074 0.050835 2024-09-22T03:17:55.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 49 16 15406 15390 2.45357 2.29688 0.0793921 0.0509158 2024-09-22T03:17:56.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:17:56.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:56.207+0000 7f861b917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:56.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:56.212+0000 7f861b917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:56.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 50 16 15677 15661 2.44684 2.11719 0.0801528 0.0510483 2024-09-22T03:17:57.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 51 16 15961 15945 2.44236 2.21875 0.037259 0.0511557 2024-09-22T03:17:57.737 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:17:57.737 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:17:57.738 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:17:57.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:57.864+0000 7f7b1e34e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:57.875+0000 7f7b1e34e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:17:58.131 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:17:58.145 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":473,"stamp":"2024-09-22T03:17:56.835785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128590387,"num_objects":1958,"num_object_clones":0,"num_object_copies":5874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":15764,"num_write_kb":126896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15709,"ondisk_log_size":15709,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":673856,"kb_used_data":189628,"kb_used_omap":0,"kb_used_meta":484160,"kb_avail":376813504,"statfs":{"total":386547056640,"available":385857028096,"internally_reserved":0,"allocated":194179072,"data_stored":385775025,"data_compressed":19868988,"data_compressed_allocated":191680512,"data_compressed_original":384835584,"omap_allocated":0,"internal_metadata":495779840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22519808,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2749,"num_write_kb":21992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.371531"},"pg_stats":[{"pgid":"10.7","version":"70'1063","reported_seq":1100,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:54.873711+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:17:54.873711+0000","last_peered":"2024-09-22T03:17:54.873711+0000","last_clean":"2024-09-22T03:17:54.873711+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:17:54.873711+0000","last_undegraded":"2024-09-22T03:17:54.873711+0000","last_fullsized":"2024-09-22T03:17:54.873711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"70'935","reported_seq":972,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:56.751993+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:17:56.751993+0000","last_peered":"2024-09-22T03:17:56.751993+0000","last_clean":"2024-09-22T03:17:56.751993+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:17:56.751993+0000","last_undegraded":"2024-09-22T03:17:56.751993+0000","last_fullsized":"2024-09-22T03:17:56.751993+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"70'1087","reported_seq":1124,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:56.399637+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:17:56.399637+0000","last_peered":"2024-09-22T03:17:56.399637+0000","last_clean":"2024-09-22T03:17:56.399637+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:17:56.399637+0000","last_undegraded":"2024-09-22T03:17:56.399637+0000","last_fullsized":"2024-09-22T03:17:56.399637+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1087,"log_dups_size":0,"ondisk_log_size":1087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912896,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1088,"num_write_kb":8704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"70'1071","reported_seq":1108,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:56.259745+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:17:56.259745+0000","last_peered":"2024-09-22T03:17:56.259745+0000","last_clean":"2024-09-22T03:17:56.259745+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:17:56.259745+0000","last_undegraded":"2024-09-22T03:17:56.259745+0000","last_fullsized":"2024-09-22T03:17:56.259745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"70'1007","reported_seq":1044,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:55.547154+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:17:55.547154+0000","last_peered":"2024-09-22T03:17:55.547154+0000","last_clean":"2024-09-22T03:17:55.547154+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:17:55.547154+0000","last_undegraded":"2024-09-22T03:17:55.547154+0000","last_fullsized":"2024-09-22T03:17:55.547154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1008,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"70'959","reported_seq":996,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:56.615530+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:17:56.615530+0000","last_peered":"2024-09-22T03:17:56.615530+0000","last_clean":"2024-09-22T03:17:56.615530+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:17:56.615530+0000","last_undegraded":"2024-09-22T03:17:56.615530+0000","last_fullsized":"2024-09-22T03:17:56.615530+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"70'791","reported_seq":828,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:54.814543+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:17:54.814543+0000","last_peered":"2024-09-22T03:17:54.814543+0000","last_clean":"2024-09-22T03:17:54.814543+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:17:54.814543+0000","last_undegraded":"2024-09-22T03:17:54.814543+0000","last_fullsized":"2024-09-22T03:17:54.814543+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"70'951","reported_seq":988,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:54.559178+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:17:54.559178+0000","last_peered":"2024-09-22T03:17:54.559178+0000","last_clean":"2024-09-22T03:17:54.559178+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:17:54.559178+0000","last_undegraded":"2024-09-22T03:17:54.559178+0000","last_fullsized":"2024-09-22T03:17:54.559178+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":951,"log_dups_size":0,"ondisk_log_size":951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"70'919","reported_seq":956,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:55.378986+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:17:55.378986+0000","last_peered":"2024-09-22T03:17:55.378986+0000","last_clean":"2024-09-22T03:17:55.378986+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:17:55.378986+0000","last_undegraded":"2024-09-22T03:17:55.378986+0000","last_fullsized":"2024-09-22T03:17:55.378986+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":184,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:53.477996+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:17:53.477996+0000","last_peered":"2024-09-22T03:17:53.477996+0000","last_clean":"2024-09-22T03:17:53.477996+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:17:53.477996+0000","last_undegraded":"2024-09-22T03:17:53.477996+0000","last_fullsized":"2024-09-22T03:17:53.477996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"70'943","reported_seq":980,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:55.580492+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:17:55.580492+0000","last_peered":"2024-09-22T03:17:55.580492+0000","last_clean":"2024-09-22T03:17:55.580492+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:17:55.580492+0000","last_undegraded":"2024-09-22T03:17:55.580492+0000","last_fullsized":"2024-09-22T03:17:55.580492+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":184,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:53.469351+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:17:53.469351+0000","last_peered":"2024-09-22T03:17:53.469351+0000","last_clean":"2024-09-22T03:17:53.469351+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:17:53.469351+0000","last_undegraded":"2024-09-22T03:17:53.469351+0000","last_fullsized":"2024-09-22T03:17:53.469351+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"70'952","reported_seq":989,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:56.787721+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:17:56.787721+0000","last_peered":"2024-09-22T03:17:56.787721+0000","last_clean":"2024-09-22T03:17:56.787721+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:17:56.787721+0000","last_undegraded":"2024-09-22T03:17:56.787721+0000","last_fullsized":"2024-09-22T03:17:56.787721+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7806976,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":953,"num_write_kb":7624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":186,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:53.474980+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:17:53.474980+0000","last_peered":"2024-09-22T03:17:53.474980+0000","last_clean":"2024-09-22T03:17:53.474980+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:17:53.474980+0000","last_undegraded":"2024-09-22T03:17:53.474980+0000","last_fullsized":"2024-09-22T03:17:53.474980+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"70'975","reported_seq":1012,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:55.996242+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:17:55.996242+0000","last_peered":"2024-09-22T03:17:55.996242+0000","last_clean":"2024-09-22T03:17:55.996242+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:17:55.996242+0000","last_undegraded":"2024-09-22T03:17:55.996242+0000","last_fullsized":"2024-09-22T03:17:55.996242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":185,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:53.482011+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:17:53.482011+0000","last_peered":"2024-09-22T03:17:53.482011+0000","last_clean":"2024-09-22T03:17:53.482011+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:17:53.482011+0000","last_undegraded":"2024-09-22T03:17:53.482011+0000","last_fullsized":"2024-09-22T03:17:53.482011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":310,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:53.473634+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:17:53.473634+0000","last_peered":"2024-09-22T03:17:53.473634+0000","last_clean":"2024-09-22T03:17:53.473634+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:17:53.473634+0000","last_undegraded":"2024-09-22T03:17:53.473634+0000","last_fullsized":"2024-09-22T03:17:53.473634+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"70'999","reported_seq":1036,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:56.449818+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:17:56.449818+0000","last_peered":"2024-09-22T03:17:56.449818+0000","last_clean":"2024-09-22T03:17:56.449818+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:17:56.449818+0000","last_undegraded":"2024-09-22T03:17:56.449818+0000","last_fullsized":"2024-09-22T03:17:56.449818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1000,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":184,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:53.478734+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:17:53.478734+0000","last_peered":"2024-09-22T03:17:53.478734+0000","last_clean":"2024-09-22T03:17:53.478734+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:17:53.478734+0000","last_undegraded":"2024-09-22T03:17:53.478734+0000","last_fullsized":"2024-09-22T03:17:53.478734+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"70'1007","reported_seq":1044,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:54.608611+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:17:54.608611+0000","last_peered":"2024-09-22T03:17:54.608611+0000","last_clean":"2024-09-22T03:17:54.608611+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:17:54.608611+0000","last_undegraded":"2024-09-22T03:17:54.608611+0000","last_fullsized":"2024-09-22T03:17:54.608611+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1008,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":184,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:53.477094+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:17:53.477094+0000","last_peered":"2024-09-22T03:17:53.477094+0000","last_clean":"2024-09-22T03:17:53.477094+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:17:53.477094+0000","last_undegraded":"2024-09-22T03:17:53.477094+0000","last_fullsized":"2024-09-22T03:17:53.477094+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"70'927","reported_seq":964,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:55.687529+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:17:55.687529+0000","last_peered":"2024-09-22T03:17:55.687529+0000","last_clean":"2024-09-22T03:17:55.687529+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:17:55.687529+0000","last_undegraded":"2024-09-22T03:17:55.687529+0000","last_fullsized":"2024-09-22T03:17:55.687529+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":184,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:53.488635+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:17:53.488635+0000","last_peered":"2024-09-22T03:17:53.488635+0000","last_clean":"2024-09-22T03:17:53.488635+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:17:53.488635+0000","last_undegraded":"2024-09-22T03:17:53.488635+0000","last_fullsized":"2024-09-22T03:17:53.488635+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"70'1023","reported_seq":1060,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:55.635568+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:17:55.635568+0000","last_peered":"2024-09-22T03:17:55.635568+0000","last_clean":"2024-09-22T03:17:55.635568+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:17:55.635568+0000","last_undegraded":"2024-09-22T03:17:55.635568+0000","last_fullsized":"2024-09-22T03:17:55.635568+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":184,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:17:53.486808+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:17:53.486808+0000","last_peered":"2024-09-22T03:17:53.486808+0000","last_clean":"2024-09-22T03:17:53.486808+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:17:53.486808+0000","last_undegraded":"2024-09-22T03:17:53.486808+0000","last_fullsized":"2024-09-22T03:17:53.486808+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":128000000,"num_objects":1954,"num_object_clones":0,"num_object_copies":5862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15625,"num_write_kb":125000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":192380928,"data_stored":384761856,"data_compressed":19864131,"data_compressed_allocated":192380928,"data_compressed_original":384761856,"omap_allocated":0,"internal_metadata":0},"log_size":15609,"ondisk_log_size":15609,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":164548,"kb_used_data":36916,"kb_used_omap":0,"kb_used_meta":127616,"kb_avail":94207292,"statfs":{"total":96636764160,"available":96468267008,"internally_reserved":0,"allocated":37801984,"data_stored":74605529,"data_compressed":3840161,"data_compressed_allocated":37191680,"data_compressed_original":74383360,"omap_allocated":0,"internal_metadata":130678784},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":150864,"kb_used_data":55744,"kb_used_omap":0,"kb_used_meta":95104,"kb_avail":94220976,"statfs":{"total":96636764160,"available":96482279424,"internally_reserved":0,"allocated":57081856,"data_stored":113632761,"data_compressed":5854581,"data_compressed_allocated":56451072,"data_compressed_original":113393664,"omap_allocated":0,"internal_metadata":97386496},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":177536,"kb_used_data":46768,"kb_used_omap":0,"kb_used_meta":130752,"kb_avail":94194304,"statfs":{"total":96636764160,"available":96454967296,"internally_reserved":0,"allocated":47890432,"data_stored":95249913,"data_compressed":4905487,"data_compressed_allocated":47259648,"data_compressed_original":95010816,"omap_allocated":0,"internal_metadata":133890048},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":180908,"kb_used_data":50200,"kb_used_omap":0,"kb_used_meta":130688,"kb_avail":94190932,"statfs":{"total":96636764160,"available":96451514368,"internally_reserved":0,"allocated":51404800,"data_stored":102286822,"data_compressed":5268759,"data_compressed_allocated":50778112,"data_compressed_original":102047744,"omap_allocated":0,"internal_metadata":133824512},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50921472,"data_stored":101842944,"data_compressed":5257834,"data_compressed_allocated":50921472,"data_compressed_original":101842944,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":47448064,"data_stored":94896128,"data_compressed":4899215,"data_compressed_allocated":47448064,"data_compressed_original":94896128,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56586240,"data_stored":113172480,"data_compressed":5842810,"data_compressed_allocated":56586240,"data_compressed_original":113172480,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37425152,"data_stored":74850304,"data_compressed":3864272,"data_compressed_allocated":37425152,"data_compressed_original":74850304,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:17:58.380 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:17:58.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:58.526+0000 7f9cd1397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:58.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:17:58.532+0000 7f9cd1397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:17:58.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 52 16 16216 16200 2.4337 1.99219 0.037744 0.0513183 2024-09-22T03:17:59.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 53 16 16481 16465 2.42684 2.07031 0.0792367 0.0514612 2024-09-22T03:18:00.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 54 16 16741 16725 2.41951 2.03125 0.0800659 0.0516313 2024-09-22T03:18:00.693 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:18:00.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:00.835+0000 7f8165b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:00.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:00.840+0000 7f8165b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:01.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 55 16 17003 16987 2.41273 2.04688 0.0748896 0.051769 2024-09-22T03:18:02.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 56 16 17274 17258 2.40745 2.11719 0.0283396 0.0518447 2024-09-22T03:18:03.025 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:18:03.147 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:18:03.147 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:18:03.148 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:18:03.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:03.165+0000 7f67fff97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:03.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:03.173+0000 7f67fff97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:03.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:03.292+0000 7fb49eaa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:03.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:03.305+0000 7fb49eaa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:18:03.565 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:18:03.569 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 57 16 17544 17528 2.40222 2.10938 0.0579116 0.0519977 2024-09-22T03:18:03.580 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2024-09-22T03:18:03.465300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":139018803,"num_objects":2117,"num_object_clones":0,"num_object_copies":6351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":17037,"num_write_kb":137080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16982,"ondisk_log_size":16982,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":660548,"kb_used_data":205440,"kb_used_omap":0,"kb_used_meta":455040,"kb_avail":376826812,"statfs":{"total":386547056640,"available":385870655488,"internally_reserved":0,"allocated":210370560,"data_stored":418105525,"data_compressed":21537723,"data_compressed_allocated":207839232,"data_compressed_original":417153024,"omap_allocated":0,"internal_metadata":465960960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22347776,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2728,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.629882"},"pg_stats":[{"pgid":"10.7","version":"71'1127","reported_seq":1167,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:00.750320+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:18:00.750320+0000","last_peered":"2024-09-22T03:18:00.750320+0000","last_clean":"2024-09-22T03:18:00.750320+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:18:00.750320+0000","last_undegraded":"2024-09-22T03:18:00.750320+0000","last_fullsized":"2024-09-22T03:18:00.750320+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"71'1047","reported_seq":1087,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:01.583091+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:18:01.583091+0000","last_peered":"2024-09-22T03:18:01.583091+0000","last_clean":"2024-09-22T03:18:01.583091+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:18:01.583091+0000","last_undegraded":"2024-09-22T03:18:01.583091+0000","last_fullsized":"2024-09-22T03:18:01.583091+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"71'1153","reported_seq":1193,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:01.762977+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:18:01.762977+0000","last_peered":"2024-09-22T03:18:01.762977+0000","last_clean":"2024-09-22T03:18:01.762977+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:18:01.762977+0000","last_undegraded":"2024-09-22T03:18:01.762977+0000","last_fullsized":"2024-09-22T03:18:01.762977+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9453568,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"71'1111","reported_seq":1151,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:00.319232+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:18:00.319232+0000","last_peered":"2024-09-22T03:18:00.319232+0000","last_clean":"2024-09-22T03:18:00.319232+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:18:00.319232+0000","last_undegraded":"2024-09-22T03:18:00.319232+0000","last_fullsized":"2024-09-22T03:18:00.319232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1111,"log_dups_size":0,"ondisk_log_size":1111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"71'1127","reported_seq":1167,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:00.683616+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:18:00.683616+0000","last_peered":"2024-09-22T03:18:00.683616+0000","last_clean":"2024-09-22T03:18:00.683616+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:18:00.683616+0000","last_undegraded":"2024-09-22T03:18:00.683616+0000","last_fullsized":"2024-09-22T03:18:00.683616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"71'1023","reported_seq":1063,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:01.743502+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:18:01.743502+0000","last_peered":"2024-09-22T03:18:01.743502+0000","last_clean":"2024-09-22T03:18:01.743502+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:18:01.743502+0000","last_undegraded":"2024-09-22T03:18:01.743502+0000","last_fullsized":"2024-09-22T03:18:01.743502+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"71'863","reported_seq":903,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:00.722248+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:18:00.722248+0000","last_peered":"2024-09-22T03:18:00.722248+0000","last_clean":"2024-09-22T03:18:00.722248+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:18:00.722248+0000","last_undegraded":"2024-09-22T03:18:00.722248+0000","last_fullsized":"2024-09-22T03:18:00.722248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"71'1007","reported_seq":1047,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:00.670074+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:18:00.670074+0000","last_peered":"2024-09-22T03:18:00.670074+0000","last_clean":"2024-09-22T03:18:00.670074+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:18:00.670074+0000","last_undegraded":"2024-09-22T03:18:00.670074+0000","last_fullsized":"2024-09-22T03:18:00.670074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1008,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"71'1015","reported_seq":1055,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:00.988387+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:18:00.988387+0000","last_peered":"2024-09-22T03:18:00.988387+0000","last_clean":"2024-09-22T03:18:00.988387+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:18:00.988387+0000","last_undegraded":"2024-09-22T03:18:00.988387+0000","last_fullsized":"2024-09-22T03:18:00.988387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1016,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:17:58.470674+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:17:58.470674+0000","last_peered":"2024-09-22T03:17:58.470674+0000","last_clean":"2024-09-22T03:17:58.470674+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:17:58.470674+0000","last_undegraded":"2024-09-22T03:17:58.470674+0000","last_fullsized":"2024-09-22T03:17:58.470674+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"71'1023","reported_seq":1063,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:00.647458+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:18:00.647458+0000","last_peered":"2024-09-22T03:18:00.647458+0000","last_clean":"2024-09-22T03:18:00.647458+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:18:00.647458+0000","last_undegraded":"2024-09-22T03:18:00.647458+0000","last_fullsized":"2024-09-22T03:18:00.647458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:17:58.498827+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:17:58.498827+0000","last_peered":"2024-09-22T03:17:58.498827+0000","last_clean":"2024-09-22T03:17:58.498827+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:17:58.498827+0000","last_undegraded":"2024-09-22T03:17:58.498827+0000","last_fullsized":"2024-09-22T03:17:58.498827+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"71'1055","reported_seq":1095,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:01.603688+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:18:01.603688+0000","last_peered":"2024-09-22T03:18:01.603688+0000","last_clean":"2024-09-22T03:18:01.603688+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:18:01.603688+0000","last_undegraded":"2024-09-22T03:18:01.603688+0000","last_fullsized":"2024-09-22T03:18:01.603688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1055,"log_dups_size":0,"ondisk_log_size":1055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1056,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":189,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:17:58.471636+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:17:58.471636+0000","last_peered":"2024-09-22T03:17:58.471636+0000","last_clean":"2024-09-22T03:17:58.471636+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:17:58.471636+0000","last_undegraded":"2024-09-22T03:17:58.471636+0000","last_fullsized":"2024-09-22T03:17:58.471636+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"71'1031","reported_seq":1071,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:00.818808+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:18:00.818808+0000","last_peered":"2024-09-22T03:18:00.818808+0000","last_clean":"2024-09-22T03:18:00.818808+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:18:00.818808+0000","last_undegraded":"2024-09-22T03:18:00.818808+0000","last_fullsized":"2024-09-22T03:18:00.818808+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":188,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:17:58.473070+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:17:58.473070+0000","last_peered":"2024-09-22T03:17:58.473070+0000","last_clean":"2024-09-22T03:17:58.473070+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:17:58.473070+0000","last_undegraded":"2024-09-22T03:17:58.473070+0000","last_fullsized":"2024-09-22T03:17:58.473070+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":313,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:17:58.499736+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:17:58.499736+0000","last_peered":"2024-09-22T03:17:58.499736+0000","last_clean":"2024-09-22T03:17:58.499736+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:17:58.499736+0000","last_undegraded":"2024-09-22T03:17:58.499736+0000","last_fullsized":"2024-09-22T03:17:58.499736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"71'1095","reported_seq":1135,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:01.516038+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:18:01.516038+0000","last_peered":"2024-09-22T03:18:01.516038+0000","last_clean":"2024-09-22T03:18:01.516038+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:18:01.516038+0000","last_undegraded":"2024-09-22T03:18:01.516038+0000","last_fullsized":"2024-09-22T03:18:01.516038+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1096,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:17:58.484762+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:17:58.484762+0000","last_peered":"2024-09-22T03:17:58.484762+0000","last_clean":"2024-09-22T03:17:58.484762+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:17:58.484762+0000","last_undegraded":"2024-09-22T03:17:58.484762+0000","last_fullsized":"2024-09-22T03:17:58.484762+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"71'1111","reported_seq":1151,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:00.589128+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:18:00.589128+0000","last_peered":"2024-09-22T03:18:00.589128+0000","last_clean":"2024-09-22T03:18:00.589128+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:18:00.589128+0000","last_undegraded":"2024-09-22T03:18:00.589128+0000","last_fullsized":"2024-09-22T03:18:00.589128+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1111,"log_dups_size":0,"ondisk_log_size":1111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:17:58.478487+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:17:58.478487+0000","last_peered":"2024-09-22T03:17:58.478487+0000","last_clean":"2024-09-22T03:17:58.478487+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:17:58.478487+0000","last_undegraded":"2024-09-22T03:17:58.478487+0000","last_fullsized":"2024-09-22T03:17:58.478487+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"71'975","reported_seq":1015,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:17:59.879602+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:17:59.879602+0000","last_peered":"2024-09-22T03:17:59.879602+0000","last_clean":"2024-09-22T03:17:59.879602+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:17:59.879602+0000","last_undegraded":"2024-09-22T03:17:59.879602+0000","last_fullsized":"2024-09-22T03:17:59.879602+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:17:58.486823+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:17:58.486823+0000","last_peered":"2024-09-22T03:17:58.486823+0000","last_clean":"2024-09-22T03:17:58.486823+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:17:58.486823+0000","last_undegraded":"2024-09-22T03:17:58.486823+0000","last_fullsized":"2024-09-22T03:17:58.486823+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"71'1119","reported_seq":1159,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:18:00.521766+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:18:00.521766+0000","last_peered":"2024-09-22T03:18:00.521766+0000","last_clean":"2024-09-22T03:18:00.521766+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:18:00.521766+0000","last_undegraded":"2024-09-22T03:18:00.521766+0000","last_fullsized":"2024-09-22T03:18:00.521766+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-22T03:17:58.490110+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:17:58.490110+0000","last_peered":"2024-09-22T03:17:58.490110+0000","last_clean":"2024-09-22T03:17:58.490110+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:17:58.490110+0000","last_undegraded":"2024-09-22T03:17:58.490110+0000","last_fullsized":"2024-09-22T03:17:58.490110+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":138428416,"num_objects":2113,"num_object_clones":0,"num_object_copies":6339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16898,"num_write_kb":135184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":208621568,"data_stored":417243136,"data_compressed":21541326,"data_compressed_allocated":208621568,"data_compressed_original":417243136,"omap_allocated":0,"internal_metadata":0},"log_size":16882,"ondisk_log_size":16882,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":171596,"kb_used_data":39804,"kb_used_omap":0,"kb_used_meta":131776,"kb_avail":94200244,"statfs":{"total":96636764160,"available":96461049856,"internally_reserved":0,"allocated":40759296,"data_stored":80507034,"data_compressed":4144721,"data_compressed_allocated":40140800,"data_compressed_original":80281600,"omap_allocated":0,"internal_metadata":134938624},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":147120,"kb_used_data":60320,"kb_used_omap":0,"kb_used_meta":86784,"kb_avail":94224720,"statfs":{"total":96636764160,"available":96486113280,"internally_reserved":0,"allocated":61767680,"data_stored":122991290,"data_compressed":6337647,"data_compressed_allocated":61128704,"data_compressed_original":122748928,"omap_allocated":0,"internal_metadata":88866816},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":169036,"kb_used_data":50744,"kb_used_omap":0,"kb_used_meta":118272,"kb_avail":94202804,"statfs":{"total":96636764160,"available":96463671296,"internally_reserved":0,"allocated":51961856,"data_stored":103379642,"data_compressed":5325103,"data_compressed_allocated":51322880,"data_compressed_original":103137280,"omap_allocated":0,"internal_metadata":121110528},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":172796,"kb_used_data":54572,"kb_used_omap":0,"kb_used_meta":118208,"kb_avail":94199044,"statfs":{"total":96636764160,"available":96459821056,"internally_reserved":0,"allocated":55881728,"data_stored":111227559,"data_compressed":5730252,"data_compressed_allocated":55246848,"data_compressed_original":110985216,"omap_allocated":0,"internal_metadata":121044992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":55468032,"data_stored":110936064,"data_compressed":5727364,"data_compressed_allocated":55468032,"data_compressed_original":110936064,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51499008,"data_stored":102998016,"data_compressed":5317562,"data_compressed_allocated":51499008,"data_compressed_original":102998016,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61321216,"data_stored":122642432,"data_compressed":6331798,"data_compressed_allocated":61321216,"data_compressed_original":122642432,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40333312,"data_stored":80666624,"data_compressed":4164602,"data_compressed_allocated":40333312,"data_compressed_original":80666624,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:18:04.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 58 16 17802 17786 2.39555 2.01562 0.0985023 0.0521449 2024-09-22T03:18:05.300 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:18:05.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:05.420+0000 7fd3062ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:05.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:05.427+0000 7fd3062ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:05.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 59 16 18048 18032 2.38752 1.92188 0.111584 0.0523305 2024-09-22T03:18:06.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:18:06.569307+0000 min lat: 0.00903376 max lat: 0.185546 avg lat: 0.0524467 2024-09-22T03:18:06.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:18:06.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 60 16 18313 18297 2.38223 2.07031 0.0529284 0.0524467 2024-09-22T03:18:07.560 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:18:07.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 61 16 18612 18596 2.38147 2.33594 0.0629971 0.0524637 2024-09-22T03:18:07.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:07.686+0000 7f20594d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:07.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:07.694+0000 7f20594d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:08.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 62 16 18838 18822 2.37153 1.76562 0.0757568 0.0526596 2024-09-22T03:18:08.582 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:18:08.582 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:18:08.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:18:08.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:08.710+0000 7fde328fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:08.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:08.719+0000 7fde328fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:09.006 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:18:09.007 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:18:09.021 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2024-09-22T03:18:08.838323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":150217267,"num_objects":2289,"num_object_clones":0,"num_object_copies":6867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":18404,"num_write_kb":148016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18349,"ondisk_log_size":18349,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":688804,"kb_used_data":221220,"kb_used_omap":0,"kb_used_meta":467520,"kb_avail":376798556,"statfs":{"total":386547056640,"available":385841721344,"internally_reserved":0,"allocated":226529280,"data_stored":450370489,"data_compressed":23203074,"data_compressed_allocated":223965184,"data_compressed_original":449404928,"omap_allocated":0,"internal_metadata":478740480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21626880,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2640,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002155"},"pg_stats":[{"pgid":"10.7","version":"72'1191","reported_seq":1234,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:04.651605+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:18:04.651605+0000","last_peered":"2024-09-22T03:18:04.651605+0000","last_clean":"2024-09-22T03:18:04.651605+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:18:04.651605+0000","last_undegraded":"2024-09-22T03:18:04.651605+0000","last_fullsized":"2024-09-22T03:18:04.651605+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"72'1127","reported_seq":1170,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:05.575513+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:18:05.575513+0000","last_peered":"2024-09-22T03:18:05.575513+0000","last_clean":"2024-09-22T03:18:05.575513+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:18:05.575513+0000","last_undegraded":"2024-09-22T03:18:05.575513+0000","last_fullsized":"2024-09-22T03:18:05.575513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"72'1231","reported_seq":1274,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:06.608298+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:18:06.608298+0000","last_peered":"2024-09-22T03:18:06.608298+0000","last_clean":"2024-09-22T03:18:06.608298+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:18:06.608298+0000","last_undegraded":"2024-09-22T03:18:06.608298+0000","last_fullsized":"2024-09-22T03:18:06.608298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1231,"log_dups_size":0,"ondisk_log_size":1231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":9856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"72'1192","reported_seq":1235,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:06.389356+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:18:06.389356+0000","last_peered":"2024-09-22T03:18:06.389356+0000","last_clean":"2024-09-22T03:18:06.389356+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:18:06.389356+0000","last_undegraded":"2024-09-22T03:18:06.389356+0000","last_fullsized":"2024-09-22T03:18:06.389356+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1192,"log_dups_size":0,"ondisk_log_size":1192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9773056,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":9544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"72'1212","reported_seq":1255,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:05.789514+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:18:05.789514+0000","last_peered":"2024-09-22T03:18:05.789514+0000","last_clean":"2024-09-22T03:18:05.789514+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:18:05.789514+0000","last_undegraded":"2024-09-22T03:18:05.789514+0000","last_fullsized":"2024-09-22T03:18:05.789514+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1212,"log_dups_size":0,"ondisk_log_size":1212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9936896,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":9704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"72'1102","reported_seq":1145,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:06.795686+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:18:06.795686+0000","last_peered":"2024-09-22T03:18:06.795686+0000","last_clean":"2024-09-22T03:18:06.795686+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:18:06.795686+0000","last_undegraded":"2024-09-22T03:18:06.795686+0000","last_fullsized":"2024-09-22T03:18:06.795686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1102,"log_dups_size":0,"ondisk_log_size":1102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9035776,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1103,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"72'975","reported_seq":1018,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:05.261254+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:18:05.261254+0000","last_peered":"2024-09-22T03:18:05.261254+0000","last_clean":"2024-09-22T03:18:05.261254+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:18:05.261254+0000","last_undegraded":"2024-09-22T03:18:05.261254+0000","last_fullsized":"2024-09-22T03:18:05.261254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"72'1087","reported_seq":1130,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:06.321735+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:18:06.321735+0000","last_peered":"2024-09-22T03:18:06.321735+0000","last_clean":"2024-09-22T03:18:06.321735+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:18:06.321735+0000","last_undegraded":"2024-09-22T03:18:06.321735+0000","last_fullsized":"2024-09-22T03:18:06.321735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1087,"log_dups_size":0,"ondisk_log_size":1087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912896,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1088,"num_write_kb":8704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"72'1071","reported_seq":1114,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:06.547130+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:18:06.547130+0000","last_peered":"2024-09-22T03:18:06.547130+0000","last_clean":"2024-09-22T03:18:06.547130+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:18:06.547130+0000","last_undegraded":"2024-09-22T03:18:06.547130+0000","last_fullsized":"2024-09-22T03:18:06.547130+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.476607+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:18:03.476607+0000","last_peered":"2024-09-22T03:18:03.476607+0000","last_clean":"2024-09-22T03:18:03.476607+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:18:03.476607+0000","last_undegraded":"2024-09-22T03:18:03.476607+0000","last_fullsized":"2024-09-22T03:18:03.476607+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"72'1107","reported_seq":1150,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:05.791902+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:18:05.791902+0000","last_peered":"2024-09-22T03:18:05.791902+0000","last_clean":"2024-09-22T03:18:05.791902+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:18:05.791902+0000","last_undegraded":"2024-09-22T03:18:05.791902+0000","last_fullsized":"2024-09-22T03:18:05.791902+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9076736,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":8864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.486434+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:18:03.486434+0000","last_peered":"2024-09-22T03:18:03.486434+0000","last_clean":"2024-09-22T03:18:03.486434+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:18:03.486434+0000","last_undegraded":"2024-09-22T03:18:03.486434+0000","last_fullsized":"2024-09-22T03:18:03.486434+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"72'1151","reported_seq":1194,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:06.728273+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:18:06.728273+0000","last_peered":"2024-09-22T03:18:06.728273+0000","last_clean":"2024-09-22T03:18:06.728273+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:18:06.728273+0000","last_undegraded":"2024-09-22T03:18:06.728273+0000","last_fullsized":"2024-09-22T03:18:06.728273+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":192,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.491928+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:18:03.491928+0000","last_peered":"2024-09-22T03:18:03.491928+0000","last_clean":"2024-09-22T03:18:03.491928+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:18:03.491928+0000","last_undegraded":"2024-09-22T03:18:03.491928+0000","last_fullsized":"2024-09-22T03:18:03.491928+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"72'1103","reported_seq":1146,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:06.566646+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:18:06.566646+0000","last_peered":"2024-09-22T03:18:06.566646+0000","last_clean":"2024-09-22T03:18:06.566646+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:18:06.566646+0000","last_undegraded":"2024-09-22T03:18:06.566646+0000","last_fullsized":"2024-09-22T03:18:06.566646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1103,"log_dups_size":0,"ondisk_log_size":1103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1104,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":191,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.483746+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:18:03.483746+0000","last_peered":"2024-09-22T03:18:03.483746+0000","last_clean":"2024-09-22T03:18:03.483746+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:18:03.483746+0000","last_undegraded":"2024-09-22T03:18:03.483746+0000","last_fullsized":"2024-09-22T03:18:03.483746+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":316,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.512012+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:18:03.512012+0000","last_peered":"2024-09-22T03:18:03.512012+0000","last_clean":"2024-09-22T03:18:03.512012+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:18:03.512012+0000","last_undegraded":"2024-09-22T03:18:03.512012+0000","last_fullsized":"2024-09-22T03:18:03.512012+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"72'1207","reported_seq":1250,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:06.491250+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:18:06.491250+0000","last_peered":"2024-09-22T03:18:06.491250+0000","last_clean":"2024-09-22T03:18:06.491250+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:18:06.491250+0000","last_undegraded":"2024-09-22T03:18:06.491250+0000","last_fullsized":"2024-09-22T03:18:06.491250+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1207,"log_dups_size":0,"ondisk_log_size":1207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.494364+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:18:03.494364+0000","last_peered":"2024-09-22T03:18:03.494364+0000","last_clean":"2024-09-22T03:18:03.494364+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:18:03.494364+0000","last_undegraded":"2024-09-22T03:18:03.494364+0000","last_fullsized":"2024-09-22T03:18:03.494364+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"72'1223","reported_seq":1266,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:05.659142+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:18:05.659142+0000","last_peered":"2024-09-22T03:18:05.659142+0000","last_clean":"2024-09-22T03:18:05.659142+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:18:05.659142+0000","last_undegraded":"2024-09-22T03:18:05.659142+0000","last_fullsized":"2024-09-22T03:18:05.659142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1223,"log_dups_size":0,"ondisk_log_size":1223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.494581+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:18:03.494581+0000","last_peered":"2024-09-22T03:18:03.494581+0000","last_clean":"2024-09-22T03:18:03.494581+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:18:03.494581+0000","last_undegraded":"2024-09-22T03:18:03.494581+0000","last_fullsized":"2024-09-22T03:18:03.494581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"72'1079","reported_seq":1122,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:05.661499+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:18:05.661499+0000","last_peered":"2024-09-22T03:18:05.661499+0000","last_clean":"2024-09-22T03:18:05.661499+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:18:05.661499+0000","last_undegraded":"2024-09-22T03:18:05.661499+0000","last_fullsized":"2024-09-22T03:18:05.661499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.495976+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:18:03.495976+0000","last_peered":"2024-09-22T03:18:03.495976+0000","last_clean":"2024-09-22T03:18:03.495976+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:18:03.495976+0000","last_undegraded":"2024-09-22T03:18:03.495976+0000","last_fullsized":"2024-09-22T03:18:03.495976+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"72'1191","reported_seq":1234,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:05.701628+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:18:05.701628+0000","last_peered":"2024-09-22T03:18:05.701628+0000","last_clean":"2024-09-22T03:18:05.701628+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:18:05.701628+0000","last_undegraded":"2024-09-22T03:18:05.701628+0000","last_fullsized":"2024-09-22T03:18:05.701628+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.495740+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:18:03.495740+0000","last_peered":"2024-09-22T03:18:03.495740+0000","last_clean":"2024-09-22T03:18:03.495740+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:18:03.495740+0000","last_undegraded":"2024-09-22T03:18:03.495740+0000","last_fullsized":"2024-09-22T03:18:03.495740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":149626880,"num_objects":2285,"num_object_clones":0,"num_object_copies":6855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18265,"num_write_kb":146120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":224755712,"data_stored":449511424,"data_compressed":23207523,"data_compressed_allocated":224755712,"data_compressed_original":449511424,"omap_allocated":0,"internal_metadata":0},"log_size":18249,"ondisk_log_size":18249,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673789,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":174184,"kb_used_data":42392,"kb_used_omap":0,"kb_used_meta":131776,"kb_avail":94197656,"statfs":{"total":96636764160,"available":96458399744,"internally_reserved":0,"allocated":43409408,"data_stored":85794139,"data_compressed":4417556,"data_compressed_allocated":42782720,"data_compressed_original":85565440,"omap_allocated":0,"internal_metadata":134938624},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673789,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":155820,"kb_used_data":64860,"kb_used_omap":0,"kb_used_meta":90944,"kb_avail":94216020,"statfs":{"total":96636764160,"available":96477204480,"internally_reserved":0,"allocated":66416640,"data_stored":132276091,"data_compressed":6816906,"data_compressed_allocated":65769472,"data_compressed_original":132030464,"omap_allocated":0,"internal_metadata":93126656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673789,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":177368,"kb_used_data":54920,"kb_used_omap":0,"kb_used_meta":122432,"kb_avail":94194472,"statfs":{"total":96636764160,"available":96455139328,"internally_reserved":0,"allocated":56238080,"data_stored":111918971,"data_compressed":5765869,"data_compressed_allocated":55590912,"data_compressed_original":111673344,"omap_allocated":0,"internal_metadata":125370368},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":181432,"kb_used_data":59048,"kb_used_omap":0,"kb_used_meta":122368,"kb_avail":94190408,"statfs":{"total":96636764160,"available":96450977792,"internally_reserved":0,"allocated":60465152,"data_stored":120381288,"data_compressed":6202743,"data_compressed_allocated":59822080,"data_compressed_original":120135680,"omap_allocated":0,"internal_metadata":125304832},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60014592,"data_stored":120029184,"data_compressed":6196894,"data_compressed_allocated":60014592,"data_compressed_original":120029184,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55730176,"data_stored":111460352,"data_compressed":5754521,"data_compressed_allocated":55730176,"data_compressed_original":111460352,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65970176,"data_stored":131940352,"data_compressed":6811903,"data_compressed_allocated":65970176,"data_compressed_original":131940352,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43040768,"data_stored":86081536,"data_compressed":4444205,"data_compressed_allocated":43040768,"data_compressed_original":86081536,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:18:09.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 63 16 19090 19074 2.36514 1.96875 0.0408771 0.0528156 2024-09-22T03:18:09.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:18:09.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:09.947+0000 7f11690d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:09.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:09.953+0000 7f11690d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:10.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 64 16 19354 19338 2.36041 2.0625 0.0884311 0.0529156 2024-09-22T03:18:11.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 65 16 19626 19610 2.35678 2.125 0.111889 0.0530207 2024-09-22T03:18:12.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:18:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:12.313+0000 7f27c2a58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:12.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:12.318+0000 7f27c2a58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:12.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 66 16 19884 19868 2.35161 2.01562 0.0401255 0.0531299 2024-09-22T03:18:13.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 67 15 20156 20141 2.34834 2.13281 0.112657 0.0531979 2024-09-22T03:18:14.023 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:18:14.024 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:18:14.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:18:14.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:14.169+0000 7f6b15f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:14.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:14.179+0000 7f6b15f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:18:14.489 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:18:14.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:18:14.504 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":483,"stamp":"2024-09-22T03:18:12.839075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":160776755,"num_objects":2449,"num_object_clones":0,"num_object_copies":7347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":19693,"num_write_kb":158328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19638,"ondisk_log_size":19638,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":722568,"kb_used_data":236936,"kb_used_omap":0,"kb_used_meta":485568,"kb_avail":376764792,"statfs":{"total":386547056640,"available":385807147008,"internally_reserved":0,"allocated":242622464,"data_stored":482556857,"data_compressed":24865041,"data_compressed_allocated":240058368,"data_compressed_original":481591296,"omap_allocated":0,"internal_metadata":497221632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2656,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002232"},"pg_stats":[{"pgid":"10.7","version":"72'1271","reported_seq":1314,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:10.722914+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:18:10.722914+0000","last_peered":"2024-09-22T03:18:10.722914+0000","last_clean":"2024-09-22T03:18:10.722914+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:18:10.722914+0000","last_undegraded":"2024-09-22T03:18:10.722914+0000","last_fullsized":"2024-09-22T03:18:10.722914+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"72'1207","reported_seq":1250,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:11.526746+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:18:11.526746+0000","last_peered":"2024-09-22T03:18:11.526746+0000","last_clean":"2024-09-22T03:18:11.526746+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:18:11.526746+0000","last_undegraded":"2024-09-22T03:18:11.526746+0000","last_fullsized":"2024-09-22T03:18:11.526746+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1207,"log_dups_size":0,"ondisk_log_size":1207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"72'1303","reported_seq":1346,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:11.337344+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:18:11.337344+0000","last_peered":"2024-09-22T03:18:11.337344+0000","last_clean":"2024-09-22T03:18:11.337344+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:18:11.337344+0000","last_undegraded":"2024-09-22T03:18:11.337344+0000","last_fullsized":"2024-09-22T03:18:11.337344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"72'1247","reported_seq":1290,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:11.572017+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:18:11.572017+0000","last_peered":"2024-09-22T03:18:11.572017+0000","last_clean":"2024-09-22T03:18:11.572017+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:18:11.572017+0000","last_undegraded":"2024-09-22T03:18:11.572017+0000","last_fullsized":"2024-09-22T03:18:11.572017+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1247,"log_dups_size":0,"ondisk_log_size":1247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":9984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"72'1279","reported_seq":1322,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:10.774838+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:18:10.774838+0000","last_peered":"2024-09-22T03:18:10.774838+0000","last_clean":"2024-09-22T03:18:10.774838+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:18:10.774838+0000","last_undegraded":"2024-09-22T03:18:10.774838+0000","last_fullsized":"2024-09-22T03:18:10.774838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":160,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1280,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"72'1231","reported_seq":1274,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:11.371704+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:18:11.371704+0000","last_peered":"2024-09-22T03:18:11.371704+0000","last_clean":"2024-09-22T03:18:11.371704+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:18:11.371704+0000","last_undegraded":"2024-09-22T03:18:11.371704+0000","last_fullsized":"2024-09-22T03:18:11.371704+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1231,"log_dups_size":0,"ondisk_log_size":1231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":9856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"72'1071","reported_seq":1114,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:10.770863+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:18:10.770863+0000","last_peered":"2024-09-22T03:18:10.770863+0000","last_clean":"2024-09-22T03:18:10.770863+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:18:10.770863+0000","last_undegraded":"2024-09-22T03:18:10.770863+0000","last_fullsized":"2024-09-22T03:18:10.770863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"72'1175","reported_seq":1218,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:11.742120+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:18:11.742120+0000","last_peered":"2024-09-22T03:18:11.742120+0000","last_clean":"2024-09-22T03:18:11.742120+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:18:11.742120+0000","last_undegraded":"2024-09-22T03:18:11.742120+0000","last_fullsized":"2024-09-22T03:18:11.742120+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"72'1151","reported_seq":1194,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:11.299965+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:18:11.299965+0000","last_peered":"2024-09-22T03:18:11.299965+0000","last_clean":"2024-09-22T03:18:11.299965+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:18:11.299965+0000","last_undegraded":"2024-09-22T03:18:11.299965+0000","last_fullsized":"2024-09-22T03:18:11.299965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.476607+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:18:03.476607+0000","last_peered":"2024-09-22T03:18:03.476607+0000","last_clean":"2024-09-22T03:18:03.476607+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:18:03.476607+0000","last_undegraded":"2024-09-22T03:18:03.476607+0000","last_fullsized":"2024-09-22T03:18:03.476607+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"72'1183","reported_seq":1226,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:10.699703+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:18:10.699703+0000","last_peered":"2024-09-22T03:18:10.699703+0000","last_clean":"2024-09-22T03:18:10.699703+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:18:10.699703+0000","last_undegraded":"2024-09-22T03:18:10.699703+0000","last_fullsized":"2024-09-22T03:18:10.699703+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1183,"log_dups_size":0,"ondisk_log_size":1183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":9472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.486434+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:18:03.486434+0000","last_peered":"2024-09-22T03:18:03.486434+0000","last_clean":"2024-09-22T03:18:03.486434+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:18:03.486434+0000","last_undegraded":"2024-09-22T03:18:03.486434+0000","last_fullsized":"2024-09-22T03:18:03.486434+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"72'1231","reported_seq":1274,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:11.484431+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:18:11.484431+0000","last_peered":"2024-09-22T03:18:11.484431+0000","last_clean":"2024-09-22T03:18:11.484431+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:18:11.484431+0000","last_undegraded":"2024-09-22T03:18:11.484431+0000","last_fullsized":"2024-09-22T03:18:11.484431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1231,"log_dups_size":0,"ondisk_log_size":1231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":9856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":192,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.491928+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:18:03.491928+0000","last_peered":"2024-09-22T03:18:03.491928+0000","last_clean":"2024-09-22T03:18:03.491928+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:18:03.491928+0000","last_undegraded":"2024-09-22T03:18:03.491928+0000","last_fullsized":"2024-09-22T03:18:03.491928+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"72'1191","reported_seq":1234,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:11.614564+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:18:11.614564+0000","last_peered":"2024-09-22T03:18:11.614564+0000","last_clean":"2024-09-22T03:18:11.614564+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:18:11.614564+0000","last_undegraded":"2024-09-22T03:18:11.614564+0000","last_fullsized":"2024-09-22T03:18:11.614564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":191,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.483746+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:18:03.483746+0000","last_peered":"2024-09-22T03:18:03.483746+0000","last_clean":"2024-09-22T03:18:03.483746+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:18:03.483746+0000","last_undegraded":"2024-09-22T03:18:03.483746+0000","last_fullsized":"2024-09-22T03:18:03.483746+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":316,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.512012+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:18:03.512012+0000","last_peered":"2024-09-22T03:18:03.512012+0000","last_clean":"2024-09-22T03:18:03.512012+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:18:03.512012+0000","last_undegraded":"2024-09-22T03:18:03.512012+0000","last_fullsized":"2024-09-22T03:18:03.512012+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"72'1311","reported_seq":1354,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:10.038121+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:18:10.038121+0000","last_peered":"2024-09-22T03:18:10.038121+0000","last_clean":"2024-09-22T03:18:10.038121+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:18:10.038121+0000","last_undegraded":"2024-09-22T03:18:10.038121+0000","last_fullsized":"2024-09-22T03:18:10.038121+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1311,"log_dups_size":0,"ondisk_log_size":1311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.494364+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:18:03.494364+0000","last_peered":"2024-09-22T03:18:03.494364+0000","last_clean":"2024-09-22T03:18:03.494364+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:18:03.494364+0000","last_undegraded":"2024-09-22T03:18:03.494364+0000","last_fullsized":"2024-09-22T03:18:03.494364+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"72'1271","reported_seq":1314,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:09.565571+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:18:09.565571+0000","last_peered":"2024-09-22T03:18:09.565571+0000","last_clean":"2024-09-22T03:18:09.565571+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:18:09.565571+0000","last_undegraded":"2024-09-22T03:18:09.565571+0000","last_fullsized":"2024-09-22T03:18:09.565571+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.494581+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:18:03.494581+0000","last_peered":"2024-09-22T03:18:03.494581+0000","last_clean":"2024-09-22T03:18:03.494581+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:18:03.494581+0000","last_undegraded":"2024-09-22T03:18:03.494581+0000","last_fullsized":"2024-09-22T03:18:03.494581+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"72'1145","reported_seq":1188,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:10.795296+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:18:10.795296+0000","last_peered":"2024-09-22T03:18:10.795296+0000","last_clean":"2024-09-22T03:18:10.795296+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:18:10.795296+0000","last_undegraded":"2024-09-22T03:18:10.795296+0000","last_fullsized":"2024-09-22T03:18:10.795296+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1145,"log_dups_size":0,"ondisk_log_size":1145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9388032,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":9168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.495976+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:18:03.495976+0000","last_peered":"2024-09-22T03:18:03.495976+0000","last_clean":"2024-09-22T03:18:03.495976+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:18:03.495976+0000","last_undegraded":"2024-09-22T03:18:03.495976+0000","last_fullsized":"2024-09-22T03:18:03.495976+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"72'1271","reported_seq":1314,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:10.646364+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:18:10.646364+0000","last_peered":"2024-09-22T03:18:10.646364+0000","last_clean":"2024-09-22T03:18:10.646364+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:18:10.646364+0000","last_undegraded":"2024-09-22T03:18:10.646364+0000","last_fullsized":"2024-09-22T03:18:10.646364+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:18:03.495740+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:18:03.495740+0000","last_peered":"2024-09-22T03:18:03.495740+0000","last_clean":"2024-09-22T03:18:03.495740+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:18:03.495740+0000","last_undegraded":"2024-09-22T03:18:03.495740+0000","last_fullsized":"2024-09-22T03:18:03.495740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":160186368,"num_objects":2445,"num_object_clones":0,"num_object_copies":7335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19554,"num_write_kb":156432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":240832512,"data_stored":481665024,"data_compressed":24867798,"data_compressed_allocated":240832512,"data_compressed_original":481665024,"omap_allocated":0,"internal_metadata":0},"log_size":19538,"ondisk_log_size":19538,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673794,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":164740,"kb_used_data":45428,"kb_used_omap":0,"kb_used_meta":119296,"kb_avail":94207100,"statfs":{"total":96636764160,"available":96468070400,"internally_reserved":0,"allocated":46518272,"data_stored":92011867,"data_compressed":4738613,"data_compressed_allocated":45891584,"data_compressed_original":91783168,"omap_allocated":0,"internal_metadata":122159104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673794,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":182364,"kb_used_data":69196,"kb_used_omap":0,"kb_used_meta":113152,"kb_avail":94189476,"statfs":{"total":96636764160,"available":96450023424,"internally_reserved":0,"allocated":70856704,"data_stored":141156219,"data_compressed":7275438,"data_compressed_allocated":70209536,"data_compressed_original":140910592,"omap_allocated":0,"internal_metadata":115867648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673794,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":185484,"kb_used_data":58876,"kb_used_omap":0,"kb_used_meta":126592,"kb_avail":94186356,"statfs":{"total":96636764160,"available":96446828544,"internally_reserved":0,"allocated":60289024,"data_stored":120020859,"data_compressed":6184216,"data_compressed_allocated":59641856,"data_compressed_original":119775232,"omap_allocated":0,"internal_metadata":129630208},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":189980,"kb_used_data":63436,"kb_used_omap":0,"kb_used_meta":126528,"kb_avail":94181860,"statfs":{"total":96636764160,"available":96442224640,"internally_reserved":0,"allocated":64958464,"data_stored":129367912,"data_compressed":6666774,"data_compressed_allocated":64315392,"data_compressed_original":129122304,"omap_allocated":0,"internal_metadata":129564672},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":64544768,"data_stored":129089536,"data_compressed":6664732,"data_compressed_allocated":64544768,"data_compressed_original":129089536,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":59895808,"data_stored":119791616,"data_compressed":6184712,"data_compressed_allocated":59895808,"data_compressed_original":119791616,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":70451200,"data_stored":140902400,"data_compressed":7274665,"data_compressed_allocated":70451200,"data_compressed_original":140902400,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45940736,"data_stored":91881472,"data_compressed":4743689,"data_compressed_allocated":45940736,"data_compressed_original":91881472,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:18:14.570 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 68 16 20414 20398 2.34333 2.00781 0.0393293 0.0533155 2024-09-22T03:18:14.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:14.642+0000 7fb25b517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:14.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:14.648+0000 7fb25b517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:15.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 69 16 20642 20626 2.33518 1.78125 0.041916 0.0534826 2024-09-22T03:18:16.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 70 16 20895 20879 2.33006 1.97656 0.0397687 0.0535957 2024-09-22T03:18:16.868 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:18:17.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:16.999+0000 7fdc97797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:17.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:17.004+0000 7fdc97797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:17.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 71 16 21146 21130 2.32486 1.96094 0.0223149 0.053729 2024-09-22T03:18:18.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 72 16 21422 21406 2.32251 2.15625 0.0555808 0.0537969 2024-09-22T03:18:19.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:18:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:19.406+0000 7f527f66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:19.413+0000 7f527f66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:19.506 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:18:19.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:18:19.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 73 16 21669 21653 2.31713 1.92969 0.108392 0.0539146 2024-09-22T03:18:19.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:19.648+0000 7fc6a2b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:19.661+0000 7fc6a2b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:18:20.536 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:18:20.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 74 16 21913 21897 2.31158 1.90625 0.0336338 0.054052 2024-09-22T03:18:20.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:20.669+0000 7f83810b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:20.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:20.684+0000 7f83810b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:21.522 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:18:21.545 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:18:21.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 75 16 22161 22145 2.30659 1.9375 0.0890671 0.0541676 2024-09-22T03:18:21.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:18:21.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:21.713+0000 7fa3cb517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:21.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:21.724+0000 7fa3cb517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:21.750+0000 7fdd3d86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:21.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:21.758+0000 7fdd3d86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:22.523 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:18:22.540 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:18:22.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 76 16 22392 22376 2.29998 1.80469 0.0696507 0.0543089 2024-09-22T03:18:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:22.684+0000 7fbd09d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:22.700+0000 7fbd09d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:23.468 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:18:23.489 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:18:23.489 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:18:23.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 77 16 22609 22593 2.29213 1.69531 0.140455 0.0544867 2024-09-22T03:18:23.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:23.651+0000 7fbcadad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:23.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:23.661+0000 7fbcadad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:23.927 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:18:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:18:23.977 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:18:23.995 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":492,"stamp":"2024-09-22T03:18:23.468256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181715507,"num_objects":2768,"num_object_clones":0,"num_object_copies":8304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":22249,"num_write_kb":178776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22203,"ondisk_log_size":22203,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":732512,"kb_used_data":267680,"kb_used_omap":0,"kb_used_meta":464768,"kb_avail":376754848,"statfs":{"total":386547056640,"available":385796964352,"internally_reserved":0,"allocated":274104320,"data_stored":545455014,"data_compressed":28111989,"data_compressed_allocated":271499264,"data_compressed_original":544473088,"omap_allocated":0,"internal_metadata":475922432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10584064,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":10336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.628034"},"pg_stats":[{"pgid":"10.7","version":"72'1416","reported_seq":1461,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.558891+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:18:20.558891+0000","last_peered":"2024-09-22T03:18:20.558891+0000","last_clean":"2024-09-22T03:18:20.558891+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:18:20.558891+0000","last_undegraded":"2024-09-22T03:18:20.558891+0000","last_fullsized":"2024-09-22T03:18:20.558891+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1416,"log_dups_size":0,"ondisk_log_size":1416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1416,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"73'1376","reported_seq":1424,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.554403+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:18:21.554403+0000","last_peered":"2024-09-22T03:18:21.554403+0000","last_clean":"2024-09-22T03:18:21.554403+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:18:21.554403+0000","last_undegraded":"2024-09-22T03:18:21.554403+0000","last_fullsized":"2024-09-22T03:18:21.554403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1376,"log_dups_size":0,"ondisk_log_size":1376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1376,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"73'1480","reported_seq":1528,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.545740+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:18:21.545740+0000","last_peered":"2024-09-22T03:18:21.545740+0000","last_clean":"2024-09-22T03:18:21.545740+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:18:21.545740+0000","last_undegraded":"2024-09-22T03:18:21.545740+0000","last_fullsized":"2024-09-22T03:18:21.545740+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1480,"log_dups_size":0,"ondisk_log_size":1480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1480,"num_write_kb":11840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"74'1367","reported_seq":1416,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.774309+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:18:21.774309+0000","last_peered":"2024-09-22T03:18:21.774309+0000","last_clean":"2024-09-22T03:18:21.774309+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:18:21.774309+0000","last_undegraded":"2024-09-22T03:18:21.774309+0000","last_fullsized":"2024-09-22T03:18:21.774309+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1367,"log_dups_size":0,"ondisk_log_size":1367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1368,"num_write_kb":10944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"73'1495","reported_seq":1541,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.711475+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:18:20.711475+0000","last_peered":"2024-09-22T03:18:20.711475+0000","last_clean":"2024-09-22T03:18:20.711475+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:18:20.711475+0000","last_undegraded":"2024-09-22T03:18:20.711475+0000","last_fullsized":"2024-09-22T03:18:20.711475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"74'1391","reported_seq":1440,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.738104+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:18:21.738104+0000","last_peered":"2024-09-22T03:18:21.738104+0000","last_clean":"2024-09-22T03:18:21.738104+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:18:21.738104+0000","last_undegraded":"2024-09-22T03:18:21.738104+0000","last_fullsized":"2024-09-22T03:18:21.738104+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1392,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"72'1176","reported_seq":1221,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.557910+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:18:20.557910+0000","last_peered":"2024-09-22T03:18:20.557910+0000","last_clean":"2024-09-22T03:18:20.557910+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:18:20.557910+0000","last_undegraded":"2024-09-22T03:18:20.557910+0000","last_fullsized":"2024-09-22T03:18:20.557910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1176,"log_dups_size":0,"ondisk_log_size":1176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"74'1335","reported_seq":1384,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.604332+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:18:21.604332+0000","last_peered":"2024-09-22T03:18:21.604332+0000","last_clean":"2024-09-22T03:18:21.604332+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:18:21.604332+0000","last_undegraded":"2024-09-22T03:18:21.604332+0000","last_fullsized":"2024-09-22T03:18:21.604332+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1335,"log_dups_size":0,"ondisk_log_size":1335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"73'1352","reported_seq":1400,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.549964+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:18:21.549964+0000","last_peered":"2024-09-22T03:18:21.549964+0000","last_clean":"2024-09-22T03:18:21.549964+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:18:21.549964+0000","last_undegraded":"2024-09-22T03:18:21.549964+0000","last_fullsized":"2024-09-22T03:18:21.549964+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075584,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":196,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.531077+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:18:21.531077+0000","last_peered":"2024-09-22T03:18:21.531077+0000","last_clean":"2024-09-22T03:18:21.531077+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:18:21.531077+0000","last_undegraded":"2024-09-22T03:18:21.531077+0000","last_fullsized":"2024-09-22T03:18:21.531077+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"72'1416","reported_seq":1461,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.556277+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:18:20.556277+0000","last_peered":"2024-09-22T03:18:20.556277+0000","last_clean":"2024-09-22T03:18:20.556277+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:18:20.556277+0000","last_undegraded":"2024-09-22T03:18:20.556277+0000","last_fullsized":"2024-09-22T03:18:20.556277+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1416,"log_dups_size":0,"ondisk_log_size":1416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1416,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":193,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.554243+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:18:20.554243+0000","last_peered":"2024-09-22T03:18:20.554243+0000","last_clean":"2024-09-22T03:18:20.554243+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:18:20.554243+0000","last_undegraded":"2024-09-22T03:18:20.554243+0000","last_fullsized":"2024-09-22T03:18:20.554243+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"74'1311","reported_seq":1360,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.783658+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:18:21.783658+0000","last_peered":"2024-09-22T03:18:21.783658+0000","last_clean":"2024-09-22T03:18:21.783658+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:18:21.783658+0000","last_undegraded":"2024-09-22T03:18:21.783658+0000","last_fullsized":"2024-09-22T03:18:21.783658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1311,"log_dups_size":0,"ondisk_log_size":1311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":198,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.539932+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:18:21.539932+0000","last_peered":"2024-09-22T03:18:21.539932+0000","last_clean":"2024-09-22T03:18:21.539932+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:18:21.539932+0000","last_undegraded":"2024-09-22T03:18:21.539932+0000","last_fullsized":"2024-09-22T03:18:21.539932+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"73'1320","reported_seq":1368,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.545905+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:18:21.545905+0000","last_peered":"2024-09-22T03:18:21.545905+0000","last_clean":"2024-09-22T03:18:21.545905+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:18:21.545905+0000","last_undegraded":"2024-09-22T03:18:21.545905+0000","last_fullsized":"2024-09-22T03:18:21.545905+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1320,"log_dups_size":0,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1320,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":197,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.534136+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:18:21.534136+0000","last_peered":"2024-09-22T03:18:21.534136+0000","last_clean":"2024-09-22T03:18:21.534136+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:18:21.534136+0000","last_undegraded":"2024-09-22T03:18:21.534136+0000","last_fullsized":"2024-09-22T03:18:21.534136+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":319,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.558878+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:18:20.558878+0000","last_peered":"2024-09-22T03:18:20.558878+0000","last_clean":"2024-09-22T03:18:20.558878+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:18:20.558878+0000","last_undegraded":"2024-09-22T03:18:20.558878+0000","last_fullsized":"2024-09-22T03:18:20.558878+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"72'1440","reported_seq":1488,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.546275+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:18:21.546275+0000","last_peered":"2024-09-22T03:18:21.546275+0000","last_clean":"2024-09-22T03:18:21.546275+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:18:21.546275+0000","last_undegraded":"2024-09-22T03:18:21.546275+0000","last_fullsized":"2024-09-22T03:18:21.546275+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1440,"log_dups_size":0,"ondisk_log_size":1440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1440,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":196,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.546684+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:18:21.546684+0000","last_peered":"2024-09-22T03:18:21.546684+0000","last_clean":"2024-09-22T03:18:21.546684+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:18:21.546684+0000","last_undegraded":"2024-09-22T03:18:21.546684+0000","last_fullsized":"2024-09-22T03:18:21.546684+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"72'1440","reported_seq":1485,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.556814+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:18:20.556814+0000","last_peered":"2024-09-22T03:18:20.556814+0000","last_clean":"2024-09-22T03:18:20.556814+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:18:20.556814+0000","last_undegraded":"2024-09-22T03:18:20.556814+0000","last_fullsized":"2024-09-22T03:18:20.556814+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1440,"log_dups_size":0,"ondisk_log_size":1440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1440,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":196,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.546278+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:18:21.546278+0000","last_peered":"2024-09-22T03:18:21.546278+0000","last_clean":"2024-09-22T03:18:21.546278+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:18:21.546278+0000","last_undegraded":"2024-09-22T03:18:21.546278+0000","last_fullsized":"2024-09-22T03:18:21.546278+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"73'1333","reported_seq":1379,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.789058+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:18:20.789058+0000","last_peered":"2024-09-22T03:18:20.789058+0000","last_clean":"2024-09-22T03:18:20.789058+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:18:20.789058+0000","last_undegraded":"2024-09-22T03:18:20.789058+0000","last_fullsized":"2024-09-22T03:18:20.789058+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1333,"log_dups_size":0,"ondisk_log_size":1333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10928128,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":10672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":196,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.554129+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:18:21.554129+0000","last_peered":"2024-09-22T03:18:21.554129+0000","last_clean":"2024-09-22T03:18:21.554129+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:18:21.554129+0000","last_undegraded":"2024-09-22T03:18:21.554129+0000","last_fullsized":"2024-09-22T03:18:21.554129+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"73'1455","reported_seq":1501,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.782369+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:18:20.782369+0000","last_peered":"2024-09-22T03:18:20.782369+0000","last_clean":"2024-09-22T03:18:20.782369+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:18:20.782369+0000","last_undegraded":"2024-09-22T03:18:20.782369+0000","last_fullsized":"2024-09-22T03:18:20.782369+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1455,"log_dups_size":0,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":196,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.551961+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:18:21.551961+0000","last_peered":"2024-09-22T03:18:21.551961+0000","last_clean":"2024-09-22T03:18:21.551961+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:18:21.551961+0000","last_undegraded":"2024-09-22T03:18:21.551961+0000","last_fullsized":"2024-09-22T03:18:21.551961+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":181125120,"num_objects":2764,"num_object_clones":0,"num_object_copies":8292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22110,"num_write_kb":176880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":272105472,"data_stored":544210944,"data_compressed":28097403,"data_compressed_allocated":272105472,"data_compressed_original":544210944,"omap_allocated":0,"internal_metadata":0},"log_size":22103,"ondisk_log_size":22103,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673804,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":174376,"kb_used_data":50904,"kb_used_omap":0,"kb_used_meta":123456,"kb_avail":94197464,"statfs":{"total":96636764160,"available":96458203136,"internally_reserved":0,"allocated":52125696,"data_stored":103200493,"data_compressed":5316008,"data_compressed_allocated":51482624,"data_compressed_original":102965248,"omap_allocated":0,"internal_metadata":126418944},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673804,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":183364,"kb_used_data":78516,"kb_used_omap":0,"kb_used_meta":104832,"kb_avail":94188476,"statfs":{"total":96636764160,"available":96448999424,"internally_reserved":0,"allocated":80400384,"data_stored":160230468,"data_compressed":8260182,"data_compressed_allocated":79745024,"data_compressed_original":159981568,"omap_allocated":0,"internal_metadata":107347968},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673804,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":184716,"kb_used_data":66428,"kb_used_omap":0,"kb_used_meta":118272,"kb_avail":94187124,"statfs":{"total":96636764160,"available":96447614976,"internally_reserved":0,"allocated":68022272,"data_stored":135474244,"data_compressed":6981994,"data_compressed_allocated":67366912,"data_compressed_original":135225344,"omap_allocated":0,"internal_metadata":121110528},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":190056,"kb_used_data":71832,"kb_used_omap":0,"kb_used_meta":118208,"kb_avail":94181784,"statfs":{"total":96636764160,"available":96442146816,"internally_reserved":0,"allocated":73555968,"data_stored":146549809,"data_compressed":7553805,"data_compressed_allocated":72904704,"data_compressed_original":146300928,"omap_allocated":0,"internal_metadata":121044992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73007104,"data_stored":146014208,"data_compressed":7538650,"data_compressed_allocated":73007104,"data_compressed_original":146014208,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":67522560,"data_stored":135045120,"data_compressed":6972338,"data_compressed_allocated":67522560,"data_compressed_original":135045120,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":79867904,"data_stored":159735808,"data_compressed":8247142,"data_compressed_allocated":79867904,"data_compressed_original":159735808,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":51707904,"data_stored":103415808,"data_compressed":5339273,"data_compressed_allocated":51707904,"data_compressed_original":103415808,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:18:23.997 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:18:24.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:24.083+0000 7f9794157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:24.091+0000 7f9794157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:24.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:24.143+0000 7faee222c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:24.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:24.153+0000 7faee222c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:18:24.478 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:18:24.495 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":492,"stamp":"2024-09-22T03:18:23.468256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181715507,"num_objects":2768,"num_object_clones":0,"num_object_copies":8304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":22249,"num_write_kb":178776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22203,"ondisk_log_size":22203,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":732512,"kb_used_data":267680,"kb_used_omap":0,"kb_used_meta":464768,"kb_avail":376754848,"statfs":{"total":386547056640,"available":385796964352,"internally_reserved":0,"allocated":274104320,"data_stored":545455014,"data_compressed":28111989,"data_compressed_allocated":271499264,"data_compressed_original":544473088,"omap_allocated":0,"internal_metadata":475922432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10584064,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":10336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.628034"},"pg_stats":[{"pgid":"10.7","version":"72'1416","reported_seq":1461,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.558891+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:18:20.558891+0000","last_peered":"2024-09-22T03:18:20.558891+0000","last_clean":"2024-09-22T03:18:20.558891+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:18:20.558891+0000","last_undegraded":"2024-09-22T03:18:20.558891+0000","last_fullsized":"2024-09-22T03:18:20.558891+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1416,"log_dups_size":0,"ondisk_log_size":1416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1416,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"73'1376","reported_seq":1424,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.554403+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:18:21.554403+0000","last_peered":"2024-09-22T03:18:21.554403+0000","last_clean":"2024-09-22T03:18:21.554403+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:18:21.554403+0000","last_undegraded":"2024-09-22T03:18:21.554403+0000","last_fullsized":"2024-09-22T03:18:21.554403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1376,"log_dups_size":0,"ondisk_log_size":1376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1376,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"73'1480","reported_seq":1528,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.545740+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:18:21.545740+0000","last_peered":"2024-09-22T03:18:21.545740+0000","last_clean":"2024-09-22T03:18:21.545740+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:18:21.545740+0000","last_undegraded":"2024-09-22T03:18:21.545740+0000","last_fullsized":"2024-09-22T03:18:21.545740+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1480,"log_dups_size":0,"ondisk_log_size":1480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1480,"num_write_kb":11840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"74'1367","reported_seq":1416,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.774309+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:18:21.774309+0000","last_peered":"2024-09-22T03:18:21.774309+0000","last_clean":"2024-09-22T03:18:21.774309+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:18:21.774309+0000","last_undegraded":"2024-09-22T03:18:21.774309+0000","last_fullsized":"2024-09-22T03:18:21.774309+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1367,"log_dups_size":0,"ondisk_log_size":1367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1368,"num_write_kb":10944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"73'1495","reported_seq":1541,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.711475+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:18:20.711475+0000","last_peered":"2024-09-22T03:18:20.711475+0000","last_clean":"2024-09-22T03:18:20.711475+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:18:20.711475+0000","last_undegraded":"2024-09-22T03:18:20.711475+0000","last_fullsized":"2024-09-22T03:18:20.711475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"74'1391","reported_seq":1440,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.738104+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:18:21.738104+0000","last_peered":"2024-09-22T03:18:21.738104+0000","last_clean":"2024-09-22T03:18:21.738104+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:18:21.738104+0000","last_undegraded":"2024-09-22T03:18:21.738104+0000","last_fullsized":"2024-09-22T03:18:21.738104+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1392,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"72'1176","reported_seq":1221,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.557910+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:18:20.557910+0000","last_peered":"2024-09-22T03:18:20.557910+0000","last_clean":"2024-09-22T03:18:20.557910+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:18:20.557910+0000","last_undegraded":"2024-09-22T03:18:20.557910+0000","last_fullsized":"2024-09-22T03:18:20.557910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1176,"log_dups_size":0,"ondisk_log_size":1176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"74'1335","reported_seq":1384,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.604332+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:18:21.604332+0000","last_peered":"2024-09-22T03:18:21.604332+0000","last_clean":"2024-09-22T03:18:21.604332+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:18:21.604332+0000","last_undegraded":"2024-09-22T03:18:21.604332+0000","last_fullsized":"2024-09-22T03:18:21.604332+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1335,"log_dups_size":0,"ondisk_log_size":1335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"73'1352","reported_seq":1400,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.549964+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:18:21.549964+0000","last_peered":"2024-09-22T03:18:21.549964+0000","last_clean":"2024-09-22T03:18:21.549964+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:18:21.549964+0000","last_undegraded":"2024-09-22T03:18:21.549964+0000","last_fullsized":"2024-09-22T03:18:21.549964+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075584,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":196,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.531077+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:18:21.531077+0000","last_peered":"2024-09-22T03:18:21.531077+0000","last_clean":"2024-09-22T03:18:21.531077+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:18:21.531077+0000","last_undegraded":"2024-09-22T03:18:21.531077+0000","last_fullsized":"2024-09-22T03:18:21.531077+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"72'1416","reported_seq":1461,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.556277+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:18:20.556277+0000","last_peered":"2024-09-22T03:18:20.556277+0000","last_clean":"2024-09-22T03:18:20.556277+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:18:20.556277+0000","last_undegraded":"2024-09-22T03:18:20.556277+0000","last_fullsized":"2024-09-22T03:18:20.556277+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1416,"log_dups_size":0,"ondisk_log_size":1416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1416,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":193,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.554243+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:18:20.554243+0000","last_peered":"2024-09-22T03:18:20.554243+0000","last_clean":"2024-09-22T03:18:20.554243+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:18:20.554243+0000","last_undegraded":"2024-09-22T03:18:20.554243+0000","last_fullsized":"2024-09-22T03:18:20.554243+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"74'1311","reported_seq":1360,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.783658+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:18:21.783658+0000","last_peered":"2024-09-22T03:18:21.783658+0000","last_clean":"2024-09-22T03:18:21.783658+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:18:21.783658+0000","last_undegraded":"2024-09-22T03:18:21.783658+0000","last_fullsized":"2024-09-22T03:18:21.783658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1311,"log_dups_size":0,"ondisk_log_size":1311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":198,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.539932+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:18:21.539932+0000","last_peered":"2024-09-22T03:18:21.539932+0000","last_clean":"2024-09-22T03:18:21.539932+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:18:21.539932+0000","last_undegraded":"2024-09-22T03:18:21.539932+0000","last_fullsized":"2024-09-22T03:18:21.539932+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"73'1320","reported_seq":1368,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.545905+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:18:21.545905+0000","last_peered":"2024-09-22T03:18:21.545905+0000","last_clean":"2024-09-22T03:18:21.545905+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:18:21.545905+0000","last_undegraded":"2024-09-22T03:18:21.545905+0000","last_fullsized":"2024-09-22T03:18:21.545905+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1320,"log_dups_size":0,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1320,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":197,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.534136+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:18:21.534136+0000","last_peered":"2024-09-22T03:18:21.534136+0000","last_clean":"2024-09-22T03:18:21.534136+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:18:21.534136+0000","last_undegraded":"2024-09-22T03:18:21.534136+0000","last_fullsized":"2024-09-22T03:18:21.534136+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":319,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.558878+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:18:20.558878+0000","last_peered":"2024-09-22T03:18:20.558878+0000","last_clean":"2024-09-22T03:18:20.558878+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:18:20.558878+0000","last_undegraded":"2024-09-22T03:18:20.558878+0000","last_fullsized":"2024-09-22T03:18:20.558878+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"72'1440","reported_seq":1488,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.546275+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:18:21.546275+0000","last_peered":"2024-09-22T03:18:21.546275+0000","last_clean":"2024-09-22T03:18:21.546275+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:18:21.546275+0000","last_undegraded":"2024-09-22T03:18:21.546275+0000","last_fullsized":"2024-09-22T03:18:21.546275+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1440,"log_dups_size":0,"ondisk_log_size":1440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1440,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":196,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.546684+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:18:21.546684+0000","last_peered":"2024-09-22T03:18:21.546684+0000","last_clean":"2024-09-22T03:18:21.546684+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:18:21.546684+0000","last_undegraded":"2024-09-22T03:18:21.546684+0000","last_fullsized":"2024-09-22T03:18:21.546684+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"72'1440","reported_seq":1485,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.556814+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:18:20.556814+0000","last_peered":"2024-09-22T03:18:20.556814+0000","last_clean":"2024-09-22T03:18:20.556814+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:18:20.556814+0000","last_undegraded":"2024-09-22T03:18:20.556814+0000","last_fullsized":"2024-09-22T03:18:20.556814+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1440,"log_dups_size":0,"ondisk_log_size":1440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1440,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":196,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.546278+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:18:21.546278+0000","last_peered":"2024-09-22T03:18:21.546278+0000","last_clean":"2024-09-22T03:18:21.546278+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:18:21.546278+0000","last_undegraded":"2024-09-22T03:18:21.546278+0000","last_fullsized":"2024-09-22T03:18:21.546278+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"73'1333","reported_seq":1379,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.789058+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:18:20.789058+0000","last_peered":"2024-09-22T03:18:20.789058+0000","last_clean":"2024-09-22T03:18:20.789058+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:18:20.789058+0000","last_undegraded":"2024-09-22T03:18:20.789058+0000","last_fullsized":"2024-09-22T03:18:20.789058+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1333,"log_dups_size":0,"ondisk_log_size":1333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10928128,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":10672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":196,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.554129+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:18:21.554129+0000","last_peered":"2024-09-22T03:18:21.554129+0000","last_clean":"2024-09-22T03:18:21.554129+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:18:21.554129+0000","last_undegraded":"2024-09-22T03:18:21.554129+0000","last_fullsized":"2024-09-22T03:18:21.554129+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"73'1455","reported_seq":1501,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T03:18:20.782369+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:18:20.782369+0000","last_peered":"2024-09-22T03:18:20.782369+0000","last_clean":"2024-09-22T03:18:20.782369+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:18:20.782369+0000","last_undegraded":"2024-09-22T03:18:20.782369+0000","last_fullsized":"2024-09-22T03:18:20.782369+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1455,"log_dups_size":0,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":196,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-22T03:18:21.551961+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:18:21.551961+0000","last_peered":"2024-09-22T03:18:21.551961+0000","last_clean":"2024-09-22T03:18:21.551961+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:18:21.551961+0000","last_undegraded":"2024-09-22T03:18:21.551961+0000","last_fullsized":"2024-09-22T03:18:21.551961+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":181125120,"num_objects":2764,"num_object_clones":0,"num_object_copies":8292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22110,"num_write_kb":176880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":272105472,"data_stored":544210944,"data_compressed":28097403,"data_compressed_allocated":272105472,"data_compressed_original":544210944,"omap_allocated":0,"internal_metadata":0},"log_size":22103,"ondisk_log_size":22103,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673804,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":174376,"kb_used_data":50904,"kb_used_omap":0,"kb_used_meta":123456,"kb_avail":94197464,"statfs":{"total":96636764160,"available":96458203136,"internally_reserved":0,"allocated":52125696,"data_stored":103200493,"data_compressed":5316008,"data_compressed_allocated":51482624,"data_compressed_original":102965248,"omap_allocated":0,"internal_metadata":126418944},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673804,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":183364,"kb_used_data":78516,"kb_used_omap":0,"kb_used_meta":104832,"kb_avail":94188476,"statfs":{"total":96636764160,"available":96448999424,"internally_reserved":0,"allocated":80400384,"data_stored":160230468,"data_compressed":8260182,"data_compressed_allocated":79745024,"data_compressed_original":159981568,"omap_allocated":0,"internal_metadata":107347968},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673804,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":184716,"kb_used_data":66428,"kb_used_omap":0,"kb_used_meta":118272,"kb_avail":94187124,"statfs":{"total":96636764160,"available":96447614976,"internally_reserved":0,"allocated":68022272,"data_stored":135474244,"data_compressed":6981994,"data_compressed_allocated":67366912,"data_compressed_original":135225344,"omap_allocated":0,"internal_metadata":121110528},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":190056,"kb_used_data":71832,"kb_used_omap":0,"kb_used_meta":118208,"kb_avail":94181784,"statfs":{"total":96636764160,"available":96442146816,"internally_reserved":0,"allocated":73555968,"data_stored":146549809,"data_compressed":7553805,"data_compressed_allocated":72904704,"data_compressed_original":146300928,"omap_allocated":0,"internal_metadata":121044992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73007104,"data_stored":146014208,"data_compressed":7538650,"data_compressed_allocated":73007104,"data_compressed_original":146014208,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":67522560,"data_stored":135045120,"data_compressed":6972338,"data_compressed_allocated":67522560,"data_compressed_original":135045120,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":79867904,"data_stored":159735808,"data_compressed":8247142,"data_compressed_allocated":79867904,"data_compressed_original":159735808,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":51707904,"data_stored":103415808,"data_compressed":5339273,"data_compressed_allocated":51707904,"data_compressed_original":103415808,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:18:24.497 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:18:24.497 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:18:24.497 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:18:24.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:18:24.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 78 16 22842 22826 2.28607 1.82031 0.0951618 0.0546364 2024-09-22T03:18:24.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:24.625+0000 7f445e658640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:24.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:24.637+0000 7f445e658640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:18:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:18:24.703 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:18:24.704 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:18:24.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:18:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:24.840+0000 7feb9d757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:24.849+0000 7feb9d757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:24.872 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:18:24.872 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:18:24.872 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:18:24.872 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:18:24.872 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:18:24.872 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:18:24.872 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:18:24.872 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:18:24.872 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:18:24.873 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:18:24.873 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:18:24.873 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:18:24.876 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:18:24.876 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:18:24.876 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:18:25.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:25.007+0000 7fe712797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:25.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:25.015+0000 7fe712797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:25.046 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:18:25.047 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:18:25.047 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:18:25.047 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:18:25.047 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:18:25.047 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:18:25.047 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:18:25.047 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:18:25.047 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:18:25.047 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:18:25.047 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:18:25.047 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:18:25.050 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:18:25.051 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:18:25.051 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:18:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:25.161+0000 7fb177f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:25.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:25.172+0000 7fb177f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:25.193 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:18:25.193 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:18:25.193 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:18:25.193 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:18:25.193 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:18:25.194 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:18:25.194 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:18:25.194 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:18:25.194 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:18:25.194 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:18:25.194 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:18:25.194 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:18:25.197 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:18:25.197 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:18:25.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 79 16 23060 23044 2.27869 1.70312 0.107065 0.0548176 2024-09-22T03:18:26.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:18:26.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:26.410+0000 7f50a1ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:26.416+0000 7f50a1ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:26.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:2024-09-22T03:18:26.570964+0000 min lat: 0.00903376 max lat: 0.196946 avg lat: 0.0549641 2024-09-22T03:18:26.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:18:26.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 80 16 23294 23278 2.27306 1.82812 0.0439965 0.0549641 2024-09-22T03:18:27.571 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 81 16 23527 23511 2.26747 1.82031 0.116969 0.0550964 2024-09-22T03:18:28.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 82 16 23770 23754 2.26297 1.89844 0.0241339 0.0552086 2024-09-22T03:18:28.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:18:28.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:28.709+0000 7f60b0f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:28.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:28.715+0000 7f60b0f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:29.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 83 16 24019 24003 2.25914 1.94531 0.0604696 0.0552885 2024-09-22T03:18:30.198 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:18:30.198 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:18:30.198 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:18:30.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:30.323+0000 7f51a3997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:30.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:30.332+0000 7f51a3997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:30.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 84 16 24251 24235 2.25382 1.8125 0.0424031 0.055432 2024-09-22T03:18:30.620 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:18:30.621 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:18:30.639 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":495,"stamp":"2024-09-22T03:18:28.841894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":190800435,"num_objects":2908,"num_object_clones":0,"num_object_copies":8724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":23358,"num_write_kb":187648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23303,"ondisk_log_size":23303,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":762788,"kb_used_data":281316,"kb_used_omap":0,"kb_used_meta":481408,"kb_avail":376724572,"statfs":{"total":386547056640,"available":385765961728,"internally_reserved":0,"allocated":288067584,"data_stored":573237321,"data_compressed":29544687,"data_compressed_allocated":285372416,"data_compressed_original":572219392,"omap_allocated":0,"internal_metadata":492961792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14704640,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1795,"num_write_kb":14360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.317566"},"pg_stats":[{"pgid":"10.7","version":"76'1476","reported_seq":1531,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:25.791512+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:18:25.791512+0000","last_peered":"2024-09-22T03:18:25.791512+0000","last_clean":"2024-09-22T03:18:25.791512+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:18:25.791512+0000","last_undegraded":"2024-09-22T03:18:25.791512+0000","last_fullsized":"2024-09-22T03:18:25.791512+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1476,"log_dups_size":0,"ondisk_log_size":1476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12099584,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1477,"num_write_kb":11816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"76'1423","reported_seq":1478,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:26.532733+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:18:26.532733+0000","last_peered":"2024-09-22T03:18:26.532733+0000","last_clean":"2024-09-22T03:18:26.532733+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:18:26.532733+0000","last_undegraded":"2024-09-22T03:18:26.532733+0000","last_fullsized":"2024-09-22T03:18:26.532733+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11665408,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1424,"num_write_kb":11392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"76'1535","reported_seq":1590,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:25.546223+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:18:25.546223+0000","last_peered":"2024-09-22T03:18:25.546223+0000","last_clean":"2024-09-22T03:18:25.546223+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:18:25.546223+0000","last_undegraded":"2024-09-22T03:18:25.546223+0000","last_fullsized":"2024-09-22T03:18:25.546223+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1536,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"76'1455","reported_seq":1510,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:26.265053+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:18:26.265053+0000","last_peered":"2024-09-22T03:18:26.265053+0000","last_clean":"2024-09-22T03:18:26.265053+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:18:26.265053+0000","last_undegraded":"2024-09-22T03:18:26.265053+0000","last_fullsized":"2024-09-22T03:18:26.265053+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1455,"log_dups_size":0,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"76'1551","reported_seq":1606,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:25.625466+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:18:25.625466+0000","last_peered":"2024-09-22T03:18:25.625466+0000","last_clean":"2024-09-22T03:18:25.625466+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:18:25.625466+0000","last_undegraded":"2024-09-22T03:18:25.625466+0000","last_fullsized":"2024-09-22T03:18:25.625466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1551,"log_dups_size":0,"ondisk_log_size":1551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1552,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"76'1487","reported_seq":1542,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:26.480505+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:18:26.480505+0000","last_peered":"2024-09-22T03:18:26.480505+0000","last_clean":"2024-09-22T03:18:26.480505+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:18:26.480505+0000","last_undegraded":"2024-09-22T03:18:26.480505+0000","last_fullsized":"2024-09-22T03:18:26.480505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1488,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"76'1263","reported_seq":1318,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:25.700729+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:18:25.700729+0000","last_peered":"2024-09-22T03:18:25.700729+0000","last_clean":"2024-09-22T03:18:25.700729+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:18:25.700729+0000","last_undegraded":"2024-09-22T03:18:25.700729+0000","last_fullsized":"2024-09-22T03:18:25.700729+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1263,"log_dups_size":0,"ondisk_log_size":1263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1264,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"76'1387","reported_seq":1442,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:26.792234+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:18:26.792234+0000","last_peered":"2024-09-22T03:18:26.792234+0000","last_clean":"2024-09-22T03:18:26.792234+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:18:26.792234+0000","last_undegraded":"2024-09-22T03:18:26.792234+0000","last_fullsized":"2024-09-22T03:18:26.792234+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1387,"log_dups_size":0,"ondisk_log_size":1387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11370496,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1388,"num_write_kb":11104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"76'1399","reported_seq":1454,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:26.560389+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:18:26.560389+0000","last_peered":"2024-09-22T03:18:26.560389+0000","last_clean":"2024-09-22T03:18:26.560389+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:18:26.560389+0000","last_undegraded":"2024-09-22T03:18:26.560389+0000","last_fullsized":"2024-09-22T03:18:26.560389+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1400,"num_write_kb":11200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.473474+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:18:23.473474+0000","last_peered":"2024-09-22T03:18:23.473474+0000","last_clean":"2024-09-22T03:18:23.473474+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:18:23.473474+0000","last_undegraded":"2024-09-22T03:18:23.473474+0000","last_fullsized":"2024-09-22T03:18:23.473474+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"76'1495","reported_seq":1550,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:25.452933+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:18:25.452933+0000","last_peered":"2024-09-22T03:18:25.452933+0000","last_clean":"2024-09-22T03:18:25.452933+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:18:25.452933+0000","last_undegraded":"2024-09-22T03:18:25.452933+0000","last_fullsized":"2024-09-22T03:18:25.452933+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.493837+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:18:23.493837+0000","last_peered":"2024-09-22T03:18:23.493837+0000","last_clean":"2024-09-22T03:18:23.493837+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:18:23.493837+0000","last_undegraded":"2024-09-22T03:18:23.493837+0000","last_fullsized":"2024-09-22T03:18:23.493837+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"76'1377","reported_seq":1432,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:26.769461+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:18:26.769461+0000","last_peered":"2024-09-22T03:18:26.769461+0000","last_clean":"2024-09-22T03:18:26.769461+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:18:26.769461+0000","last_undegraded":"2024-09-22T03:18:26.769461+0000","last_fullsized":"2024-09-22T03:18:26.769461+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11288576,"num_objects":173,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1378,"num_write_kb":11024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":204,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.490326+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:18:23.490326+0000","last_peered":"2024-09-22T03:18:23.490326+0000","last_clean":"2024-09-22T03:18:23.490326+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:18:23.490326+0000","last_undegraded":"2024-09-22T03:18:23.490326+0000","last_fullsized":"2024-09-22T03:18:23.490326+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"76'1375","reported_seq":1430,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:26.594355+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:18:26.594355+0000","last_peered":"2024-09-22T03:18:26.594355+0000","last_clean":"2024-09-22T03:18:26.594355+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:18:26.594355+0000","last_undegraded":"2024-09-22T03:18:26.594355+0000","last_fullsized":"2024-09-22T03:18:26.594355+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1376,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":203,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.476504+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:18:23.476504+0000","last_peered":"2024-09-22T03:18:23.476504+0000","last_clean":"2024-09-22T03:18:23.476504+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:18:23.476504+0000","last_undegraded":"2024-09-22T03:18:23.476504+0000","last_fullsized":"2024-09-22T03:18:23.476504+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":328,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.499278+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:18:23.499278+0000","last_peered":"2024-09-22T03:18:23.499278+0000","last_clean":"2024-09-22T03:18:23.499278+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:18:23.499278+0000","last_undegraded":"2024-09-22T03:18:23.499278+0000","last_fullsized":"2024-09-22T03:18:23.499278+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"76'1519","reported_seq":1574,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:25.525751+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:18:25.525751+0000","last_peered":"2024-09-22T03:18:25.525751+0000","last_clean":"2024-09-22T03:18:25.525751+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:18:25.525751+0000","last_undegraded":"2024-09-22T03:18:25.525751+0000","last_fullsized":"2024-09-22T03:18:25.525751+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1519,"log_dups_size":0,"ondisk_log_size":1519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1520,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.500856+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:18:23.500856+0000","last_peered":"2024-09-22T03:18:23.500856+0000","last_clean":"2024-09-22T03:18:23.500856+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:18:23.500856+0000","last_undegraded":"2024-09-22T03:18:23.500856+0000","last_fullsized":"2024-09-22T03:18:23.500856+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"76'1495","reported_seq":1550,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:25.047891+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:18:25.047891+0000","last_peered":"2024-09-22T03:18:25.047891+0000","last_clean":"2024-09-22T03:18:25.047891+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:18:25.047891+0000","last_undegraded":"2024-09-22T03:18:25.047891+0000","last_fullsized":"2024-09-22T03:18:25.047891+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.490285+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:18:23.490285+0000","last_peered":"2024-09-22T03:18:23.490285+0000","last_clean":"2024-09-22T03:18:23.490285+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:18:23.490285+0000","last_undegraded":"2024-09-22T03:18:23.490285+0000","last_fullsized":"2024-09-22T03:18:23.490285+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"76'1439","reported_seq":1494,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:25.660814+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:18:25.660814+0000","last_peered":"2024-09-22T03:18:25.660814+0000","last_clean":"2024-09-22T03:18:25.660814+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:18:25.660814+0000","last_undegraded":"2024-09-22T03:18:25.660814+0000","last_fullsized":"2024-09-22T03:18:25.660814+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1440,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.505552+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:18:23.505552+0000","last_peered":"2024-09-22T03:18:23.505552+0000","last_clean":"2024-09-22T03:18:23.505552+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:18:23.505552+0000","last_undegraded":"2024-09-22T03:18:23.505552+0000","last_fullsized":"2024-09-22T03:18:23.505552+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"76'1527","reported_seq":1582,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:25.762454+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:18:25.762454+0000","last_peered":"2024-09-22T03:18:25.762454+0000","last_clean":"2024-09-22T03:18:25.762454+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:18:25.762454+0000","last_undegraded":"2024-09-22T03:18:25.762454+0000","last_fullsized":"2024-09-22T03:18:25.762454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1527,"log_dups_size":0,"ondisk_log_size":1527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12517376,"num_objects":191,"num_object_clones":0,"num_object_copies":573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1528,"num_write_kb":12224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.505157+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:18:23.505157+0000","last_peered":"2024-09-22T03:18:23.505157+0000","last_clean":"2024-09-22T03:18:23.505157+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:18:23.505157+0000","last_undegraded":"2024-09-22T03:18:23.505157+0000","last_fullsized":"2024-09-22T03:18:23.505157+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":190210048,"num_objects":2904,"num_object_clones":0,"num_object_copies":8712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23219,"num_write_kb":185752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":285908992,"data_stored":571817984,"data_compressed":29522910,"data_compressed_allocated":285908992,"data_compressed_original":571817984,"omap_allocated":0,"internal_metadata":0},"log_size":23203,"ondisk_log_size":23203,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673809,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":181220,"kb_used_data":53588,"kb_used_omap":0,"kb_used_meta":127616,"kb_avail":94190620,"statfs":{"total":96636764160,"available":96451194880,"internally_reserved":0,"allocated":54874112,"data_stored":108671103,"data_compressed":5598149,"data_compressed_allocated":54214656,"data_compressed_original":108429312,"omap_allocated":0,"internal_metadata":130678784},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673809,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":191328,"kb_used_data":82320,"kb_used_omap":0,"kb_used_meta":108992,"kb_avail":94180512,"statfs":{"total":96636764160,"available":96440844288,"internally_reserved":0,"allocated":84295680,"data_stored":167981727,"data_compressed":8659916,"data_compressed_allocated":83615744,"data_compressed_original":167723008,"omap_allocated":0,"internal_metadata":111607808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673809,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":192312,"kb_used_data":69864,"kb_used_omap":0,"kb_used_meta":122432,"kb_avail":94179528,"statfs":{"total":96636764160,"available":96439836672,"internally_reserved":0,"allocated":71540736,"data_stored":142471839,"data_compressed":7342812,"data_compressed_allocated":70860800,"data_compressed_original":142213120,"omap_allocated":0,"internal_metadata":125370368},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706513,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":197928,"kb_used_data":75544,"kb_used_omap":0,"kb_used_meta":122368,"kb_avail":94173912,"statfs":{"total":96636764160,"available":96434085888,"internally_reserved":0,"allocated":77357056,"data_stored":154112652,"data_compressed":7943810,"data_compressed_allocated":76681216,"data_compressed_original":153853952,"omap_allocated":0,"internal_metadata":125304832},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":76795904,"data_stored":153591808,"data_compressed":7929924,"data_compressed_allocated":76795904,"data_compressed_original":153591808,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71028736,"data_stored":142057472,"data_compressed":7334425,"data_compressed_allocated":71028736,"data_compressed_original":142057472,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":83812352,"data_stored":167624704,"data_compressed":8654490,"data_compressed_allocated":83812352,"data_compressed_original":167624704,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":54272000,"data_stored":108544000,"data_compressed":5604071,"data_compressed_allocated":54272000,"data_compressed_original":108544000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:18:30.873 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:18:31.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:31.023+0000 7f15338fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:31.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:31.028+0000 7f15338fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:31.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 85 16 24462 24446 2.24669 1.64844 0.100761 0.055592 2024-09-22T03:18:32.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 86 16 24713 24697 2.24337 1.96094 0.0972841 0.0556808 2024-09-22T03:18:33.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:18:33.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:33.332+0000 7fb01b317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:33.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:33.337+0000 7fb01b317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:33.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 87 16 24951 24935 2.23895 1.85938 0.0727961 0.0558015 2024-09-22T03:18:34.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 88 16 25207 25191 2.23624 2 0.0383679 0.055863 2024-09-22T03:18:35.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:18:35.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 89 16 25461 25445 2.2334 1.98438 0.198963 0.0559381 2024-09-22T03:18:35.641 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:18:35.641 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:18:35.641 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:18:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:35.685+0000 7fc384e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:35.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:35.692+0000 7fc384e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:35.792+0000 7f3fde06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:35.801+0000 7f3fde06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:36.074 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:18:36.075 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:18:36.089 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-22T03:18:34.842914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":200401459,"num_objects":3055,"num_object_clones":0,"num_object_copies":9165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":24530,"num_write_kb":197024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24475,"ondisk_log_size":24475,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":793564,"kb_used_data":295452,"kb_used_omap":0,"kb_used_meta":498048,"kb_avail":376693796,"statfs":{"total":386547056640,"available":385734447104,"internally_reserved":0,"allocated":302542848,"data_stored":602187849,"data_compressed":31039569,"data_compressed_allocated":299847680,"data_compressed_original":601169920,"omap_allocated":0,"internal_metadata":510001152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18685952,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2281,"num_write_kb":18248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.374657"},"pg_stats":[{"pgid":"10.7","version":"76'1591","reported_seq":1646,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:30.062242+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:18:30.062242+0000","last_peered":"2024-09-22T03:18:30.062242+0000","last_clean":"2024-09-22T03:18:30.062242+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:18:30.062242+0000","last_undegraded":"2024-09-22T03:18:30.062242+0000","last_fullsized":"2024-09-22T03:18:30.062242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1591,"log_dups_size":0,"ondisk_log_size":1591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13041664,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1592,"num_write_kb":12736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"76'1499","reported_seq":1554,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:31.792840+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:18:31.792840+0000","last_peered":"2024-09-22T03:18:31.792840+0000","last_clean":"2024-09-22T03:18:31.792840+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:18:31.792840+0000","last_undegraded":"2024-09-22T03:18:31.792840+0000","last_fullsized":"2024-09-22T03:18:31.792840+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1499,"log_dups_size":0,"ondisk_log_size":1499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288000,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1500,"num_write_kb":12000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"76'1671","reported_seq":1726,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:31.651441+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:18:31.651441+0000","last_peered":"2024-09-22T03:18:31.651441+0000","last_clean":"2024-09-22T03:18:31.651441+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:18:31.651441+0000","last_undegraded":"2024-09-22T03:18:31.651441+0000","last_fullsized":"2024-09-22T03:18:31.651441+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1671,"log_dups_size":0,"ondisk_log_size":1671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1672,"num_write_kb":13376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"76'1543","reported_seq":1598,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:30.665736+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:18:30.665736+0000","last_peered":"2024-09-22T03:18:30.665736+0000","last_clean":"2024-09-22T03:18:30.665736+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:18:30.665736+0000","last_undegraded":"2024-09-22T03:18:30.665736+0000","last_fullsized":"2024-09-22T03:18:30.665736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1543,"log_dups_size":0,"ondisk_log_size":1543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12648448,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1544,"num_write_kb":12352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"76'1599","reported_seq":1654,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:30.348931+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:18:30.348931+0000","last_peered":"2024-09-22T03:18:30.348931+0000","last_clean":"2024-09-22T03:18:30.348931+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:18:30.348931+0000","last_undegraded":"2024-09-22T03:18:30.348931+0000","last_fullsized":"2024-09-22T03:18:30.348931+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1599,"log_dups_size":0,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1600,"num_write_kb":12800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"76'1559","reported_seq":1614,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:30.012846+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:18:30.012846+0000","last_peered":"2024-09-22T03:18:30.012846+0000","last_clean":"2024-09-22T03:18:30.012846+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:18:30.012846+0000","last_undegraded":"2024-09-22T03:18:30.012846+0000","last_fullsized":"2024-09-22T03:18:30.012846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1559,"log_dups_size":0,"ondisk_log_size":1559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779520,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1560,"num_write_kb":12480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"76'1311","reported_seq":1366,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:28.912089+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:18:28.912089+0000","last_peered":"2024-09-22T03:18:28.912089+0000","last_clean":"2024-09-22T03:18:28.912089+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:18:28.912089+0000","last_undegraded":"2024-09-22T03:18:28.912089+0000","last_fullsized":"2024-09-22T03:18:28.912089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1311,"log_dups_size":0,"ondisk_log_size":1311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"76'1463","reported_seq":1518,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:31.335672+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:18:31.335672+0000","last_peered":"2024-09-22T03:18:31.335672+0000","last_clean":"2024-09-22T03:18:31.335672+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:18:31.335672+0000","last_undegraded":"2024-09-22T03:18:31.335672+0000","last_fullsized":"2024-09-22T03:18:31.335672+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1463,"log_dups_size":0,"ondisk_log_size":1463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1464,"num_write_kb":11712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"76'1463","reported_seq":1518,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:31.655346+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:18:31.655346+0000","last_peered":"2024-09-22T03:18:31.655346+0000","last_clean":"2024-09-22T03:18:31.655346+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:18:31.655346+0000","last_undegraded":"2024-09-22T03:18:31.655346+0000","last_fullsized":"2024-09-22T03:18:31.655346+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1463,"log_dups_size":0,"ondisk_log_size":1463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1464,"num_write_kb":11712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.473474+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:18:23.473474+0000","last_peered":"2024-09-22T03:18:23.473474+0000","last_clean":"2024-09-22T03:18:23.473474+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:18:23.473474+0000","last_undegraded":"2024-09-22T03:18:23.473474+0000","last_fullsized":"2024-09-22T03:18:23.473474+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"76'1551","reported_seq":1606,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:30.610171+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:18:30.610171+0000","last_peered":"2024-09-22T03:18:30.610171+0000","last_clean":"2024-09-22T03:18:30.610171+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:18:30.610171+0000","last_undegraded":"2024-09-22T03:18:30.610171+0000","last_fullsized":"2024-09-22T03:18:30.610171+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1551,"log_dups_size":0,"ondisk_log_size":1551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1552,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.493837+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:18:23.493837+0000","last_peered":"2024-09-22T03:18:23.493837+0000","last_clean":"2024-09-22T03:18:23.493837+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:18:23.493837+0000","last_undegraded":"2024-09-22T03:18:23.493837+0000","last_fullsized":"2024-09-22T03:18:23.493837+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"76'1415","reported_seq":1470,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:31.445802+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:18:31.445802+0000","last_peered":"2024-09-22T03:18:31.445802+0000","last_clean":"2024-09-22T03:18:31.445802+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:18:31.445802+0000","last_undegraded":"2024-09-22T03:18:31.445802+0000","last_fullsized":"2024-09-22T03:18:31.445802+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1416,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":204,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.490326+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:18:23.490326+0000","last_peered":"2024-09-22T03:18:23.490326+0000","last_clean":"2024-09-22T03:18:23.490326+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:18:23.490326+0000","last_undegraded":"2024-09-22T03:18:23.490326+0000","last_fullsized":"2024-09-22T03:18:23.490326+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"76'1417","reported_seq":1472,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:31.754981+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:18:31.754981+0000","last_peered":"2024-09-22T03:18:31.754981+0000","last_clean":"2024-09-22T03:18:31.754981+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:18:31.754981+0000","last_undegraded":"2024-09-22T03:18:31.754981+0000","last_fullsized":"2024-09-22T03:18:31.754981+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1417,"log_dups_size":0,"ondisk_log_size":1417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11616256,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1418,"num_write_kb":11344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":203,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.476504+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:18:23.476504+0000","last_peered":"2024-09-22T03:18:23.476504+0000","last_clean":"2024-09-22T03:18:23.476504+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:18:23.476504+0000","last_undegraded":"2024-09-22T03:18:23.476504+0000","last_fullsized":"2024-09-22T03:18:23.476504+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":328,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.499278+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:18:23.499278+0000","last_peered":"2024-09-22T03:18:23.499278+0000","last_clean":"2024-09-22T03:18:23.499278+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:18:23.499278+0000","last_undegraded":"2024-09-22T03:18:23.499278+0000","last_fullsized":"2024-09-22T03:18:23.499278+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"76'1599","reported_seq":1654,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:31.274916+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:18:31.274916+0000","last_peered":"2024-09-22T03:18:31.274916+0000","last_clean":"2024-09-22T03:18:31.274916+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:18:31.274916+0000","last_undegraded":"2024-09-22T03:18:31.274916+0000","last_fullsized":"2024-09-22T03:18:31.274916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1599,"log_dups_size":0,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1600,"num_write_kb":12800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.500856+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:18:23.500856+0000","last_peered":"2024-09-22T03:18:23.500856+0000","last_clean":"2024-09-22T03:18:23.500856+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:18:23.500856+0000","last_undegraded":"2024-09-22T03:18:23.500856+0000","last_fullsized":"2024-09-22T03:18:23.500856+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"76'1575","reported_seq":1630,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:30.763660+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:18:30.763660+0000","last_peered":"2024-09-22T03:18:30.763660+0000","last_clean":"2024-09-22T03:18:30.763660+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:18:30.763660+0000","last_undegraded":"2024-09-22T03:18:30.763660+0000","last_fullsized":"2024-09-22T03:18:30.763660+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1576,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.490285+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:18:23.490285+0000","last_peered":"2024-09-22T03:18:23.490285+0000","last_clean":"2024-09-22T03:18:23.490285+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:18:23.490285+0000","last_undegraded":"2024-09-22T03:18:23.490285+0000","last_fullsized":"2024-09-22T03:18:23.490285+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"76'1504","reported_seq":1559,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:30.164383+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:18:30.164383+0000","last_peered":"2024-09-22T03:18:30.164383+0000","last_clean":"2024-09-22T03:18:30.164383+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:18:30.164383+0000","last_undegraded":"2024-09-22T03:18:30.164383+0000","last_fullsized":"2024-09-22T03:18:30.164383+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12328960,"num_objects":189,"num_object_clones":0,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1505,"num_write_kb":12040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.505552+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:18:23.505552+0000","last_peered":"2024-09-22T03:18:23.505552+0000","last_clean":"2024-09-22T03:18:23.505552+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:18:23.505552+0000","last_undegraded":"2024-09-22T03:18:23.505552+0000","last_fullsized":"2024-09-22T03:18:23.505552+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"76'1615","reported_seq":1670,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:30.597467+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:18:30.597467+0000","last_peered":"2024-09-22T03:18:30.597467+0000","last_clean":"2024-09-22T03:18:30.597467+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:18:30.597467+0000","last_undegraded":"2024-09-22T03:18:30.597467+0000","last_fullsized":"2024-09-22T03:18:30.597467+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1616,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.505157+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:18:23.505157+0000","last_peered":"2024-09-22T03:18:23.505157+0000","last_clean":"2024-09-22T03:18:23.505157+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:18:23.505157+0000","last_undegraded":"2024-09-22T03:18:23.505157+0000","last_fullsized":"2024-09-22T03:18:23.505157+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":199811072,"num_objects":3051,"num_object_clones":0,"num_object_copies":9153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24391,"num_write_kb":195128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":300433408,"data_stored":600866816,"data_compressed":31022868,"data_compressed_allocated":300433408,"data_compressed_original":600866816,"omap_allocated":0,"internal_metadata":0},"log_size":24375,"ondisk_log_size":24375,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":188052,"kb_used_data":56260,"kb_used_omap":0,"kb_used_meta":131776,"kb_avail":94183788,"statfs":{"total":96636764160,"available":96444198912,"internally_reserved":0,"allocated":57610240,"data_stored":114143359,"data_compressed":5880713,"data_compressed_allocated":56950784,"data_compressed_original":113901568,"omap_allocated":0,"internal_metadata":134938624},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":199748,"kb_used_data":86580,"kb_used_omap":0,"kb_used_meta":113152,"kb_avail":94172092,"statfs":{"total":96636764160,"available":96432222208,"internally_reserved":0,"allocated":88657920,"data_stored":176706207,"data_compressed":9110411,"data_compressed_allocated":87977984,"data_compressed_original":176447488,"omap_allocated":0,"internal_metadata":115867648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":200024,"kb_used_data":73416,"kb_used_omap":0,"kb_used_meta":126592,"kb_avail":94171816,"statfs":{"total":96636764160,"available":96431939584,"internally_reserved":0,"allocated":75177984,"data_stored":149746335,"data_compressed":7718436,"data_compressed_allocated":74498048,"data_compressed_original":149487616,"omap_allocated":0,"internal_metadata":129630208},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":205740,"kb_used_data":79196,"kb_used_omap":0,"kb_used_meta":126528,"kb_avail":94166100,"statfs":{"total":96636764160,"available":96426086400,"internally_reserved":0,"allocated":81096704,"data_stored":161591948,"data_compressed":8330009,"data_compressed_allocated":80420864,"data_compressed_original":161333248,"omap_allocated":0,"internal_metadata":129564672},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":80445440,"data_stored":160890880,"data_compressed":8306817,"data_compressed_allocated":80445440,"data_compressed_original":160890880,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":74694656,"data_stored":149389312,"data_compressed":7713010,"data_compressed_allocated":74694656,"data_compressed_original":149389312,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":88190976,"data_stored":176381952,"data_compressed":9106677,"data_compressed_allocated":88190976,"data_compressed_original":176381952,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57102336,"data_stored":114204672,"data_compressed":5896364,"data_compressed_allocated":57102336,"data_compressed_original":114204672,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:18:36.572 INFO:tasks.radosbench.radosbench.0.smithi134.stdout: 90 12 25688 25676 2.22864 1.80469 0.0251494 0.056055 2024-09-22T03:18:37.573 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total time run: 90.0524 2024-09-22T03:18:37.573 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Total writes made: 25688 2024-09-22T03:18:37.573 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Write size: 8192 2024-09-22T03:18:37.573 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Object size: 65536 2024-09-22T03:18:37.573 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Bandwidth (MB/sec): 2.22856 2024-09-22T03:18:37.573 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Bandwidth: 0.319875 2024-09-22T03:18:37.573 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max bandwidth (MB/sec): 2.90625 2024-09-22T03:18:37.573 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min bandwidth (MB/sec): 1.64844 2024-09-22T03:18:37.573 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average IOPS: 285 2024-09-22T03:18:37.573 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev IOPS: 40.944 2024-09-22T03:18:37.574 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max IOPS: 372 2024-09-22T03:18:37.574 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min IOPS: 211 2024-09-22T03:18:37.574 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Average Latency(s): 0.0560683 2024-09-22T03:18:37.574 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Stddev Latency(s): 0.0256427 2024-09-22T03:18:37.574 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Max latency(s): 0.198963 2024-09-22T03:18:37.574 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Min latency(s): 0.00903376 2024-09-22T03:18:37.593 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:18:37.834 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:18:37.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:37.989+0000 7f8077197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:37.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:37.997+0000 7f8077197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:40.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:18:40.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:40.445+0000 7fa60826c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:40.454+0000 7fa60826c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:41.091 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:18:41.091 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:18:41.091 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:18:41.092 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:18:41.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:41.238+0000 7f956fc2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:41.252+0000 7f956fc2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:41.281 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:18:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:18:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:18:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:18:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:18:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:18:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:18:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:18:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:18:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:18:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:18:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:18:41.286 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:18:41.286 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:18:41.286 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:18:41.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:41.444+0000 7f561626c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:41.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:41.465+0000 7f561626c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:41.604 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:18:41.605 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:18:41.605 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:18:41.605 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:18:41.605 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:18:41.605 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:18:41.605 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:18:41.605 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:18:41.605 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:18:41.605 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:18:41.605 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:18:41.605 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:18:41.609 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:18:41.610 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:18:41.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:18:41.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:41.762+0000 7f46ebb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:41.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:41.777+0000 7f46ebb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:41.879 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:18:41.880 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:18:41.880 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:18:41.880 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:18:41.880 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:18:41.880 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:18:41.880 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:18:41.880 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:18:41.880 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:18:41.880 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:18:41.880 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:18:41.880 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:18:41.883 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:18:41.883 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:18:41.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:18:42.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:42.034+0000 7f186d418640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:42.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:42.046+0000 7f186d418640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:42.075 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-22T03:18:42.076 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-22T03:18:42.076 INFO:teuthology.orchestra.run.smithi134.stderr:config help 2024-09-22T03:18:42.076 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-22T03:18:42.076 INFO:teuthology.orchestra.run.smithi134.stderr:config show 2024-09-22T03:18:42.076 INFO:teuthology.orchestra.run.smithi134.stderr:deep_scrub 2024-09-22T03:18:42.076 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_ops 2024-09-22T03:18:42.076 INFO:teuthology.orchestra.run.smithi134.stderr:dump_historic_slow_ops 2024-09-22T03:18:42.076 INFO:teuthology.orchestra.run.smithi134.stderr:dump_metrics [] 2024-09-22T03:18:42.076 INFO:teuthology.orchestra.run.smithi134.stderr:dump_ops_in_flight 2024-09-22T03:18:42.076 INFO:teuthology.orchestra.run.smithi134.stderr:dump_pgstate_history 2024-09-22T03:18:42.076 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-22T03:18:42.079 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:18:42.080 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:18:42.724 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:18:42.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:42.861+0000 7f07b4597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:42.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:42.868+0000 7f07b4597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:45.081 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:18:45.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:45.237+0000 7f2863d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:45.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:45.245+0000 7f2863d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:47.080 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:18:47.081 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:18:47.081 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:18:47.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:47.221+0000 7fcdba517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:47.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:47.231+0000 7fcdba517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:47.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:18:47.574 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:18:47.574 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:18:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":504,"stamp":"2024-09-22T03:18:46.845291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":40043083,"num_objects":607,"num_object_clones":0,"num_object_copies":1821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":28437,"num_write_kb":207401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28382,"ondisk_log_size":28382,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":534348,"kb_used_data":61132,"kb_used_omap":0,"kb_used_meta":473088,"kb_avail":376953012,"statfs":{"total":386547056640,"available":385999884288,"internally_reserved":0,"allocated":62599168,"data_stored":122275985,"data_compressed":6262293,"data_compressed_allocated":59891712,"data_compressed_original":121257984,"omap_allocated":0,"internal_metadata":484442112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-160358376,"num_objects":-2448,"num_object_clones":0,"num_object_copies":-7344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3907,"num_write_kb":10377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002376"},"pg_stats":[{"pgid":"10.7","version":"76'1862","reported_seq":1917,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:45.667753+0000","last_change":"2024-09-22T03:17:05.582239+0000","last_active":"2024-09-22T03:18:45.667753+0000","last_peered":"2024-09-22T03:18:45.667753+0000","last_clean":"2024-09-22T03:18:45.667753+0000","last_became_active":"2024-09-22T03:17:05.579027+0000","last_became_peered":"2024-09-22T03:17:05.579027+0000","last_unstale":"2024-09-22T03:18:45.667753+0000","last_undegraded":"2024-09-22T03:18:45.667753+0000","last_fullsized":"2024-09-22T03:18:45.667753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1862,"log_dups_size":0,"ondisk_log_size":1862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1863,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"76'1762","reported_seq":1817,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:46.755835+0000","last_change":"2024-09-22T03:17:05.574900+0000","last_active":"2024-09-22T03:18:46.755835+0000","last_peered":"2024-09-22T03:18:46.755835+0000","last_clean":"2024-09-22T03:18:46.755835+0000","last_became_active":"2024-09-22T03:17:05.570934+0000","last_became_peered":"2024-09-22T03:17:05.570934+0000","last_unstale":"2024-09-22T03:18:46.755835+0000","last_undegraded":"2024-09-22T03:18:46.755835+0000","last_fullsized":"2024-09-22T03:18:46.755835+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1762,"log_dups_size":0,"ondisk_log_size":1762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1763,"num_write_kb":12736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"76'1895","reported_seq":1950,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:46.536758+0000","last_change":"2024-09-22T03:17:05.574098+0000","last_active":"2024-09-22T03:18:46.536758+0000","last_peered":"2024-09-22T03:18:46.536758+0000","last_clean":"2024-09-22T03:18:46.536758+0000","last_became_active":"2024-09-22T03:17:05.566787+0000","last_became_peered":"2024-09-22T03:17:05.566787+0000","last_unstale":"2024-09-22T03:18:46.536758+0000","last_undegraded":"2024-09-22T03:18:46.536758+0000","last_fullsized":"2024-09-22T03:18:46.536758+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1895,"log_dups_size":0,"ondisk_log_size":1895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1896,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"76'1784","reported_seq":1839,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:46.758662+0000","last_change":"2024-09-22T03:17:05.590227+0000","last_active":"2024-09-22T03:18:46.758662+0000","last_peered":"2024-09-22T03:18:46.758662+0000","last_clean":"2024-09-22T03:18:46.758662+0000","last_became_active":"2024-09-22T03:17:05.586892+0000","last_became_peered":"2024-09-22T03:17:05.586892+0000","last_unstale":"2024-09-22T03:18:46.758662+0000","last_undegraded":"2024-09-22T03:18:46.758662+0000","last_fullsized":"2024-09-22T03:18:46.758662+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1785,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"76'1841","reported_seq":1896,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:45.727407+0000","last_change":"2024-09-22T03:17:05.554133+0000","last_active":"2024-09-22T03:18:45.727407+0000","last_peered":"2024-09-22T03:18:45.727407+0000","last_clean":"2024-09-22T03:18:45.727407+0000","last_became_active":"2024-09-22T03:17:05.548509+0000","last_became_peered":"2024-09-22T03:17:05.548509+0000","last_unstale":"2024-09-22T03:18:45.727407+0000","last_undegraded":"2024-09-22T03:18:45.727407+0000","last_fullsized":"2024-09-22T03:18:45.727407+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1841,"log_dups_size":0,"ondisk_log_size":1841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1842,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"76'1803","reported_seq":1858,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:46.667088+0000","last_change":"2024-09-22T03:17:05.540590+0000","last_active":"2024-09-22T03:18:46.667088+0000","last_peered":"2024-09-22T03:18:46.667088+0000","last_clean":"2024-09-22T03:18:46.667088+0000","last_became_active":"2024-09-22T03:17:05.535288+0000","last_became_peered":"2024-09-22T03:17:05.535288+0000","last_unstale":"2024-09-22T03:18:46.667088+0000","last_undegraded":"2024-09-22T03:18:46.667088+0000","last_fullsized":"2024-09-22T03:18:46.667088+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1803,"log_dups_size":0,"ondisk_log_size":1803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1804,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"76'1574","reported_seq":1629,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:45.717614+0000","last_change":"2024-09-22T03:17:05.622131+0000","last_active":"2024-09-22T03:18:45.717614+0000","last_peered":"2024-09-22T03:18:45.717614+0000","last_clean":"2024-09-22T03:18:45.717614+0000","last_became_active":"2024-09-22T03:17:05.583999+0000","last_became_peered":"2024-09-22T03:17:05.583999+0000","last_unstale":"2024-09-22T03:18:45.717614+0000","last_undegraded":"2024-09-22T03:18:45.717614+0000","last_fullsized":"2024-09-22T03:18:45.717614+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1574,"log_dups_size":0,"ondisk_log_size":1574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1575,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"76'1676","reported_seq":1731,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:46.652460+0000","last_change":"2024-09-22T03:17:05.567356+0000","last_active":"2024-09-22T03:18:46.652460+0000","last_peered":"2024-09-22T03:18:46.652460+0000","last_clean":"2024-09-22T03:18:46.652460+0000","last_became_active":"2024-09-22T03:17:05.562608+0000","last_became_peered":"2024-09-22T03:17:05.562608+0000","last_unstale":"2024-09-22T03:18:46.652460+0000","last_undegraded":"2024-09-22T03:18:46.652460+0000","last_fullsized":"2024-09-22T03:18:46.652460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1676,"log_dups_size":0,"ondisk_log_size":1676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1677,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"76'1743","reported_seq":1798,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:46.752260+0000","last_change":"2024-09-22T03:17:05.585405+0000","last_active":"2024-09-22T03:18:46.752260+0000","last_peered":"2024-09-22T03:18:46.752260+0000","last_clean":"2024-09-22T03:18:46.752260+0000","last_became_active":"2024-09-22T03:17:05.581701+0000","last_became_peered":"2024-09-22T03:17:05.581701+0000","last_unstale":"2024-09-22T03:18:46.752260+0000","last_undegraded":"2024-09-22T03:18:46.752260+0000","last_fullsized":"2024-09-22T03:18:46.752260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1744,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.473474+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:18:23.473474+0000","last_peered":"2024-09-22T03:18:23.473474+0000","last_clean":"2024-09-22T03:18:23.473474+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:18:23.473474+0000","last_undegraded":"2024-09-22T03:18:23.473474+0000","last_fullsized":"2024-09-22T03:18:23.473474+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"76'1756","reported_seq":1811,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:45.702448+0000","last_change":"2024-09-22T03:17:05.628664+0000","last_active":"2024-09-22T03:18:45.702448+0000","last_peered":"2024-09-22T03:18:45.702448+0000","last_clean":"2024-09-22T03:18:45.702448+0000","last_became_active":"2024-09-22T03:17:05.624802+0000","last_became_peered":"2024-09-22T03:17:05.624802+0000","last_unstale":"2024-09-22T03:18:45.702448+0000","last_undegraded":"2024-09-22T03:18:45.702448+0000","last_fullsized":"2024-09-22T03:18:45.702448+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1757,"num_write_kb":12864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.493837+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:18:23.493837+0000","last_peered":"2024-09-22T03:18:23.493837+0000","last_clean":"2024-09-22T03:18:23.493837+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:18:23.493837+0000","last_undegraded":"2024-09-22T03:18:23.493837+0000","last_fullsized":"2024-09-22T03:18:23.493837+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"76'1610","reported_seq":1665,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:46.619577+0000","last_change":"2024-09-22T03:17:05.550481+0000","last_active":"2024-09-22T03:18:46.619577+0000","last_peered":"2024-09-22T03:18:46.619577+0000","last_clean":"2024-09-22T03:18:46.619577+0000","last_became_active":"2024-09-22T03:17:05.545890+0000","last_became_peered":"2024-09-22T03:17:05.545890+0000","last_unstale":"2024-09-22T03:18:46.619577+0000","last_undegraded":"2024-09-22T03:18:46.619577+0000","last_fullsized":"2024-09-22T03:18:46.619577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1610,"log_dups_size":0,"ondisk_log_size":1610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1611,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":204,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.490326+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:18:23.490326+0000","last_peered":"2024-09-22T03:18:23.490326+0000","last_clean":"2024-09-22T03:18:23.490326+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:18:23.490326+0000","last_undegraded":"2024-09-22T03:18:23.490326+0000","last_fullsized":"2024-09-22T03:18:23.490326+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"76'1683","reported_seq":1738,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:46.471075+0000","last_change":"2024-09-22T03:17:05.573676+0000","last_active":"2024-09-22T03:18:46.471075+0000","last_peered":"2024-09-22T03:18:46.471075+0000","last_clean":"2024-09-22T03:18:46.471075+0000","last_became_active":"2024-09-22T03:17:05.567362+0000","last_became_peered":"2024-09-22T03:17:05.567362+0000","last_unstale":"2024-09-22T03:18:46.471075+0000","last_undegraded":"2024-09-22T03:18:46.471075+0000","last_fullsized":"2024-09-22T03:18:46.471075+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1683,"log_dups_size":0,"ondisk_log_size":1683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1684,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":203,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.476504+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:18:23.476504+0000","last_peered":"2024-09-22T03:18:23.476504+0000","last_clean":"2024-09-22T03:18:23.476504+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:18:23.476504+0000","last_undegraded":"2024-09-22T03:18:23.476504+0000","last_fullsized":"2024-09-22T03:18:23.476504+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":328,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.499278+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:18:23.499278+0000","last_peered":"2024-09-22T03:18:23.499278+0000","last_clean":"2024-09-22T03:18:23.499278+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:18:23.499278+0000","last_undegraded":"2024-09-22T03:18:23.499278+0000","last_fullsized":"2024-09-22T03:18:23.499278+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"76'1835","reported_seq":1890,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:46.673331+0000","last_change":"2024-09-22T03:17:05.560576+0000","last_active":"2024-09-22T03:18:46.673331+0000","last_peered":"2024-09-22T03:18:46.673331+0000","last_clean":"2024-09-22T03:18:46.673331+0000","last_became_active":"2024-09-22T03:17:05.538752+0000","last_became_peered":"2024-09-22T03:17:05.538752+0000","last_unstale":"2024-09-22T03:18:46.673331+0000","last_undegraded":"2024-09-22T03:18:46.673331+0000","last_fullsized":"2024-09-22T03:18:46.673331+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1836,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.500856+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:18:23.500856+0000","last_peered":"2024-09-22T03:18:23.500856+0000","last_clean":"2024-09-22T03:18:23.500856+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:18:23.500856+0000","last_undegraded":"2024-09-22T03:18:23.500856+0000","last_fullsized":"2024-09-22T03:18:23.500856+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"76'1847","reported_seq":1902,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:45.577311+0000","last_change":"2024-09-22T03:17:05.572346+0000","last_active":"2024-09-22T03:18:45.577311+0000","last_peered":"2024-09-22T03:18:45.577311+0000","last_clean":"2024-09-22T03:18:45.577311+0000","last_became_active":"2024-09-22T03:17:05.567340+0000","last_became_peered":"2024-09-22T03:17:05.567340+0000","last_unstale":"2024-09-22T03:18:45.577311+0000","last_undegraded":"2024-09-22T03:18:45.577311+0000","last_fullsized":"2024-09-22T03:18:45.577311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1848,"num_write_kb":13504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.490285+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:18:23.490285+0000","last_peered":"2024-09-22T03:18:23.490285+0000","last_clean":"2024-09-22T03:18:23.490285+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:18:23.490285+0000","last_undegraded":"2024-09-22T03:18:23.490285+0000","last_fullsized":"2024-09-22T03:18:23.490285+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"76'1779","reported_seq":1835,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:45.756212+0000","last_change":"2024-09-22T03:17:05.570355+0000","last_active":"2024-09-22T03:18:45.756212+0000","last_peered":"2024-09-22T03:18:45.756212+0000","last_clean":"2024-09-22T03:18:45.756212+0000","last_became_active":"2024-09-22T03:17:05.563365+0000","last_became_peered":"2024-09-22T03:17:05.563365+0000","last_unstale":"2024-09-22T03:18:45.756212+0000","last_undegraded":"2024-09-22T03:18:45.756212+0000","last_fullsized":"2024-09-22T03:18:45.756212+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1779,"log_dups_size":0,"ondisk_log_size":1779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735576,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1780,"num_write_kb":13057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.505552+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:18:23.505552+0000","last_peered":"2024-09-22T03:18:23.505552+0000","last_clean":"2024-09-22T03:18:23.505552+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:18:23.505552+0000","last_undegraded":"2024-09-22T03:18:23.505552+0000","last_fullsized":"2024-09-22T03:18:23.505552+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"76'1832","reported_seq":1887,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:45.732374+0000","last_change":"2024-09-22T03:17:05.551380+0000","last_active":"2024-09-22T03:18:45.732374+0000","last_peered":"2024-09-22T03:18:45.732374+0000","last_clean":"2024-09-22T03:18:45.732374+0000","last_became_active":"2024-09-22T03:17:05.545685+0000","last_became_peered":"2024-09-22T03:17:05.545685+0000","last_unstale":"2024-09-22T03:18:45.732374+0000","last_undegraded":"2024-09-22T03:18:45.732374+0000","last_fullsized":"2024-09-22T03:18:45.732374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:17:04.463206+0000","last_clean_scrub_stamp":"2024-09-22T03:17:04.463206+0000","objects_scrubbed":0,"log_size":1832,"log_dups_size":0,"ondisk_log_size":1832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":13376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T03:18:23.505157+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:18:23.505157+0000","last_peered":"2024-09-22T03:18:23.505157+0000","last_clean":"2024-09-22T03:18:23.505157+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:18:23.505157+0000","last_undegraded":"2024-09-22T03:18:23.505157+0000","last_fullsized":"2024-09-22T03:18:23.505157+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":39452696,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28298,"num_write_kb":205505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52899840,"data_stored":105775176,"data_compressed":5461773,"data_compressed_allocated":52887552,"data_compressed_original":105775104,"omap_allocated":0,"internal_metadata":0},"log_size":28282,"ondisk_log_size":28282,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133364,"kb_used_data":9892,"kb_used_omap":0,"kb_used_meta":123456,"kb_avail":94238476,"statfs":{"total":96636764160,"available":96500199424,"internally_reserved":0,"allocated":10129408,"data_stored":19181695,"data_compressed":977976,"data_compressed_allocated":9469952,"data_compressed_original":18939904,"omap_allocated":0,"internal_metadata":126418944},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125140,"kb_used_data":16100,"kb_used_omap":0,"kb_used_meta":108992,"kb_avail":94246700,"statfs":{"total":96636764160,"available":96508620800,"internally_reserved":0,"allocated":16486400,"data_stored":32354999,"data_compressed":1657663,"data_compressed_allocated":15802368,"data_compressed_original":32096256,"omap_allocated":0,"internal_metadata":111607808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131988,"kb_used_data":13668,"kb_used_omap":0,"kb_used_meta":118272,"kb_avail":94239852,"statfs":{"total":96636764160,"available":96501608448,"internally_reserved":0,"allocated":13996032,"data_stored":27374263,"data_compressed":1400479,"data_compressed_allocated":13312000,"data_compressed_original":27115520,"omap_allocated":0,"internal_metadata":121110528},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143856,"kb_used_data":21472,"kb_used_omap":0,"kb_used_meta":122368,"kb_avail":94227984,"statfs":{"total":96636764160,"available":96489455616,"internally_reserved":0,"allocated":21987328,"data_stored":43365028,"data_compressed":2226175,"data_compressed_allocated":21307392,"data_compressed_original":43106304,"omap_allocated":0,"internal_metadata":125304832},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19795968,"data_stored":39583768,"data_compressed":2043935,"data_compressed_allocated":19791872,"data_compressed_original":39583744,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11276288,"data_stored":22544408,"data_compressed":1164095,"data_compressed_allocated":11272192,"data_compressed_original":22544384,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13537280,"data_stored":27066392,"data_compressed":1397591,"data_compressed_allocated":13533184,"data_compressed_original":27066368,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8290304,"data_stored":16580608,"data_compressed":856152,"data_compressed_allocated":8290304,"data_compressed_original":16580608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:18:47.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:47.630+0000 7f88d0797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:47.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:47.637+0000 7f88d0797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:48.453 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Removed 3211 objects 2024-09-22T03:18:48.454 INFO:tasks.radosbench.radosbench.0.smithi134.stdout:Clean up completed and total clean up time :10.8606 2024-09-22T03:18:49.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:18:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:50.013+0000 7f3ddda6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:50.017+0000 7f3ddda6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:50.229 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_7 2024-09-22T03:18:50.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_7 unique_pool_7 --yes-i-really-really-mean-it 2024-09-22T03:18:50.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:50.329+0000 7f6022b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:50.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:50.340+0000 7f6022b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:51.518 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'unique_pool_7' removed 2024-09-22T03:18:51.539 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-22T03:18:51.547 INFO:tasks.thrashosds:joining thrashosds 2024-09-22T03:18:52.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-22T03:18:52.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:52.700+0000 7fb03a86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:52.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:52.705+0000 7fb03a86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:52.719 INFO:teuthology.orchestra.run.smithi134.stdout:{} 2024-09-22T03:18:52.719 INFO:teuthology.orchestra.run.smithi134.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T03:18:52.729 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:18:52.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:52.827+0000 7fe1e1797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:52.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:52.836+0000 7fe1e1797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:53.473 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:18:53.490 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-22T03:18:53.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:53.589+0000 7f7053b03640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:53.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:53.598+0000 7f7053b03640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:54.522 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-22T03:18:54.544 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:18:54.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:54.650+0000 7f04fdf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:54.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:54.658+0000 7f04fdf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:18:55.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-22T03:18:55.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:55.654+0000 7f9bdf04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:55.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:55.663+0000 7f9bdf04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:56.532 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-22T03:18:56.554 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:18:56.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:56.654+0000 7f74b9757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:56.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:56.663+0000 7f74b9757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:57.543 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:18:57.561 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-22T03:18:57.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:57.665+0000 7fa2df517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:57.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:57.674+0000 7fa2df517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:58.547 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-22T03:18:58.566 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:18:58.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:58.664+0000 7fcd28997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:58.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:58.672+0000 7fcd28997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:59.548 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:18:59.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-22T03:18:59.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:59.672+0000 7fac31597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:18:59.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:18:59.681+0000 7fac31597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:00.553 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-22T03:19:00.572 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-22T03:19:00.572 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T03:19:00.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:19:00.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:00.674+0000 7f3f9d2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:00.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:00.681+0000 7f3f9d2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:00.859 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:19:00.859 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":85,"fsid":"3c083707-cce1-453e-8e70-29f18e875f9d","created":"2024-09-22T03:04:08.385553+0000","modified":"2024-09-22T03:19:00.551167+0000","last_up_change":"2024-09-22T03:04:16.701908+0000","last_in_change":"2024-09-22T03:04:10.540409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-22T03:04:18.643341+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-09-22T03:04:18.723036+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff5d97d6-a2e2-418e-bafc-bb5c698ac90b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":3237802792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3237802792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":3237802792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3237802792}]},"public_addr":"172.21.15.134:6801/3237802792","cluster_addr":"172.21.15.134:6802/3237802792","heartbeat_back_addr":"172.21.15.134:6805/3237802792","heartbeat_front_addr":"172.21.15.134:6806/3237802792","state":["exists","up"]},{"osd":1,"uuid":"a8e1b061-b453-4df2-adaa-7d0dbfd1b5b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2010837962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2010837962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":2010837962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2010837962}]},"public_addr":"172.21.15.134:6804/2010837962","cluster_addr":"172.21.15.134:6807/2010837962","heartbeat_back_addr":"172.21.15.134:6809/2010837962","heartbeat_front_addr":"172.21.15.134:6808/2010837962","state":["exists","up"]},{"osd":2,"uuid":"9bcfb0f2-be7f-4950-a879-546f296b63cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":2068530255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2068530255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6809","nonce":2068530255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2068530255}]},"public_addr":"172.21.15.139:6805/2068530255","cluster_addr":"172.21.15.139:6804/2068530255","heartbeat_back_addr":"172.21.15.139:6809/2068530255","heartbeat_front_addr":"172.21.15.139:6808/2068530255","state":["exists","up"]},{"osd":3,"uuid":"593b511d-7c06-4d5e-83e2-d89568e0666b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6803","nonce":2508851681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2508851681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2508851681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":2508851681}]},"public_addr":"172.21.15.139:6803/2508851681","cluster_addr":"172.21.15.139:6802/2508851681","heartbeat_back_addr":"172.21.15.139:6812/2508851681","heartbeat_front_addr":"172.21.15.139:6811/2508851681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:19:00.872 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T03:19:00.872 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:19:00.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:00.971+0000 7face086c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:00.977+0000 7face086c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.155 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:19:01.155 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":85,"fsid":"3c083707-cce1-453e-8e70-29f18e875f9d","created":"2024-09-22T03:04:08.385553+0000","modified":"2024-09-22T03:19:00.551167+0000","last_up_change":"2024-09-22T03:04:16.701908+0000","last_in_change":"2024-09-22T03:04:10.540409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-22T03:04:18.643341+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-09-22T03:04:18.723036+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff5d97d6-a2e2-418e-bafc-bb5c698ac90b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":3237802792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3237802792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":3237802792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3237802792}]},"public_addr":"172.21.15.134:6801/3237802792","cluster_addr":"172.21.15.134:6802/3237802792","heartbeat_back_addr":"172.21.15.134:6805/3237802792","heartbeat_front_addr":"172.21.15.134:6806/3237802792","state":["exists","up"]},{"osd":1,"uuid":"a8e1b061-b453-4df2-adaa-7d0dbfd1b5b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2010837962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2010837962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":2010837962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2010837962}]},"public_addr":"172.21.15.134:6804/2010837962","cluster_addr":"172.21.15.134:6807/2010837962","heartbeat_back_addr":"172.21.15.134:6809/2010837962","heartbeat_front_addr":"172.21.15.134:6808/2010837962","state":["exists","up"]},{"osd":2,"uuid":"9bcfb0f2-be7f-4950-a879-546f296b63cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":2068530255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2068530255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6809","nonce":2068530255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2068530255}]},"public_addr":"172.21.15.139:6805/2068530255","cluster_addr":"172.21.15.139:6804/2068530255","heartbeat_back_addr":"172.21.15.139:6809/2068530255","heartbeat_front_addr":"172.21.15.139:6808/2068530255","state":["exists","up"]},{"osd":3,"uuid":"593b511d-7c06-4d5e-83e2-d89568e0666b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6803","nonce":2508851681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2508851681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2508851681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":2508851681}]},"public_addr":"172.21.15.139:6803/2508851681","cluster_addr":"172.21.15.139:6802/2508851681","heartbeat_back_addr":"172.21.15.139:6812/2508851681","heartbeat_front_addr":"172.21.15.139:6811/2508851681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:19:01.168 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T03:19:01.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T03:19:01.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T03:19:01.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T03:19:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.279+0000 7f5986e18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.279+0000 7f494c46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.279+0000 7f5e0354e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.279+0000 7ff1c9f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.288+0000 7f5986e18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.288+0000 7f494c46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.288+0000 7ff1c9f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.288+0000 7f5e0354e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.320 INFO:teuthology.orchestra.run.smithi134.stdout:42949673843 2024-09-22T03:19:01.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T03:19:01.322 INFO:teuthology.orchestra.run.smithi134.stdout:38654706548 2024-09-22T03:19:01.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T03:19:01.324 INFO:teuthology.orchestra.run.smithi134.stdout:42949673843 2024-09-22T03:19:01.325 INFO:teuthology.orchestra.run.smithi134.stdout:42949673843 2024-09-22T03:19:01.325 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T03:19:01.326 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T03:19:01.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.428+0000 7fa2e942c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.441+0000 7fa2e942c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.474+0000 7f08ffb03640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.477+0000 7fed164c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.483+0000 7f08ffb03640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.488+0000 7fed164c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.482+0000 7fd81d117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:01.494+0000 7fd81d117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:01.717 INFO:teuthology.orchestra.run.smithi134.stdout:42949673839 2024-09-22T03:19:01.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673843 got 42949673839 for osd.3 2024-09-22T03:19:01.736 INFO:teuthology.orchestra.run.smithi134.stdout:42949673839 2024-09-22T03:19:01.738 INFO:teuthology.orchestra.run.smithi134.stdout:38654706548 2024-09-22T03:19:01.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673843 got 42949673839 for osd.2 2024-09-22T03:19:01.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706548 got 38654706548 for osd.0 2024-09-22T03:19:01.756 DEBUG:teuthology.parallel:result is None 2024-09-22T03:19:01.763 INFO:teuthology.orchestra.run.smithi134.stdout:42949673839 2024-09-22T03:19:01.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673843 got 42949673839 for osd.1 2024-09-22T03:19:02.735 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T03:19:02.751 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T03:19:02.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T03:19:02.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:02.853+0000 7f5a65557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:02.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:02.863+0000 7f5a65557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:02.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:02.889+0000 7f6070717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:02.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:02.897+0000 7f6070717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:02.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:02.893+0000 7fb8a6c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:02.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:02.902+0000 7fb8a6c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:03.058 INFO:teuthology.orchestra.run.smithi134.stdout:42949673839 2024-09-22T03:19:03.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673843 got 42949673839 for osd.3 2024-09-22T03:19:03.087 INFO:teuthology.orchestra.run.smithi134.stdout:42949673839 2024-09-22T03:19:03.092 INFO:teuthology.orchestra.run.smithi134.stdout:42949673839 2024-09-22T03:19:03.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673843 got 42949673839 for osd.1 2024-09-22T03:19:03.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673843 got 42949673839 for osd.2 2024-09-22T03:19:04.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T03:19:04.101 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T03:19:04.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T03:19:04.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:04.180+0000 7fa4bac2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:04.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:04.191+0000 7fa4bac2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:04.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:04.221+0000 7f74e5b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:04.229+0000 7f74e5b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:04.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:04.232+0000 7f230754e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:04.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:04.241+0000 7f230754e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:04.397 INFO:teuthology.orchestra.run.smithi134.stdout:42949673844 2024-09-22T03:19:04.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673843 got 42949673844 for osd.3 2024-09-22T03:19:04.411 DEBUG:teuthology.parallel:result is None 2024-09-22T03:19:04.422 INFO:teuthology.orchestra.run.smithi134.stdout:42949673844 2024-09-22T03:19:04.429 INFO:teuthology.orchestra.run.smithi134.stdout:42949673844 2024-09-22T03:19:04.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673843 got 42949673844 for osd.1 2024-09-22T03:19:04.436 DEBUG:teuthology.parallel:result is None 2024-09-22T03:19:04.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673843 got 42949673844 for osd.2 2024-09-22T03:19:04.443 DEBUG:teuthology.parallel:result is None 2024-09-22T03:19:04.443 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:19:04.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:19:04.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:04.581+0000 7fc15e458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:04.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:04.588+0000 7fc15e458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:04.767 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:19:04.768 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:19:04.780 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":521,"stamp":"2024-09-22T03:19:02.849139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":398640,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":396416,"kb_avail":377088720,"statfs":{"total":386547056640,"available":386138849280,"internally_reserved":0,"allocated":2113536,"data_stored":2494681,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":405929984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.306050"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560981+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:19:00.560981+0000","last_peered":"2024-09-22T03:19:00.560981+0000","last_clean":"2024-09-22T03:19:00.560981+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:19:00.560981+0000","last_undegraded":"2024-09-22T03:19:00.560981+0000","last_fullsized":"2024-09-22T03:19:00.560981+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.568676+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:19:00.568676+0000","last_peered":"2024-09-22T03:19:00.568676+0000","last_clean":"2024-09-22T03:19:00.568676+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:19:00.568676+0000","last_undegraded":"2024-09-22T03:19:00.568676+0000","last_fullsized":"2024-09-22T03:19:00.568676+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560973+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:19:00.560973+0000","last_peered":"2024-09-22T03:19:00.560973+0000","last_clean":"2024-09-22T03:19:00.560973+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:19:00.560973+0000","last_undegraded":"2024-09-22T03:19:00.560973+0000","last_fullsized":"2024-09-22T03:19:00.560973+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562358+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:19:00.562358+0000","last_peered":"2024-09-22T03:19:00.562358+0000","last_clean":"2024-09-22T03:19:00.562358+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:19:00.562358+0000","last_undegraded":"2024-09-22T03:19:00.562358+0000","last_fullsized":"2024-09-22T03:19:00.562358+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":355,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.570781+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:19:00.570781+0000","last_peered":"2024-09-22T03:19:00.570781+0000","last_clean":"2024-09-22T03:19:00.570781+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:19:00.570781+0000","last_undegraded":"2024-09-22T03:19:00.570781+0000","last_fullsized":"2024-09-22T03:19:00.570781+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.561236+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:19:00.561236+0000","last_peered":"2024-09-22T03:19:00.561236+0000","last_clean":"2024-09-22T03:19:00.561236+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:19:00.561236+0000","last_undegraded":"2024-09-22T03:19:00.561236+0000","last_fullsized":"2024-09-22T03:19:00.561236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.563322+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:19:00.563322+0000","last_peered":"2024-09-22T03:19:00.563322+0000","last_clean":"2024-09-22T03:19:00.563322+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:19:00.563322+0000","last_undegraded":"2024-09-22T03:19:00.563322+0000","last_fullsized":"2024-09-22T03:19:00.563322+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562819+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:19:00.562819+0000","last_peered":"2024-09-22T03:19:00.562819+0000","last_clean":"2024-09-22T03:19:00.562819+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:19:00.562819+0000","last_undegraded":"2024-09-22T03:19:00.562819+0000","last_fullsized":"2024-09-22T03:19:00.562819+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562357+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:19:00.562357+0000","last_peered":"2024-09-22T03:19:00.562357+0000","last_clean":"2024-09-22T03:19:00.562357+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:19:00.562357+0000","last_undegraded":"2024-09-22T03:19:00.562357+0000","last_fullsized":"2024-09-22T03:19:00.562357+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123968,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":123456,"kb_avail":94247872,"statfs":{"total":96636764160,"available":96509820928,"internally_reserved":0,"allocated":483328,"data_stored":180899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":126418944},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113724,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":113152,"kb_avail":94258116,"statfs":{"total":96636764160,"available":96520310784,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":115867648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123004,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":122432,"kb_avail":94248836,"statfs":{"total":96636764160,"available":96510808064,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":125370368},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37944,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":37376,"kb_avail":94333896,"statfs":{"total":96636764160,"available":96597909504,"internally_reserved":0,"allocated":540672,"data_stored":771248,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":38273024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:19:04.781 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:19:04.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:04.878+0000 7f4cca02c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:04.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:04.885+0000 7f4cca02c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:19:05.065 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:19:05.077 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-22T03:19:04.849548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":398640,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":396416,"kb_avail":377088720,"statfs":{"total":386547056640,"available":386138849280,"internally_reserved":0,"allocated":2113536,"data_stored":2494681,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":405929984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.302850"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560981+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:19:00.560981+0000","last_peered":"2024-09-22T03:19:00.560981+0000","last_clean":"2024-09-22T03:19:00.560981+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:19:00.560981+0000","last_undegraded":"2024-09-22T03:19:00.560981+0000","last_fullsized":"2024-09-22T03:19:00.560981+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.568676+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:19:00.568676+0000","last_peered":"2024-09-22T03:19:00.568676+0000","last_clean":"2024-09-22T03:19:00.568676+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:19:00.568676+0000","last_undegraded":"2024-09-22T03:19:00.568676+0000","last_fullsized":"2024-09-22T03:19:00.568676+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560973+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:19:00.560973+0000","last_peered":"2024-09-22T03:19:00.560973+0000","last_clean":"2024-09-22T03:19:00.560973+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:19:00.560973+0000","last_undegraded":"2024-09-22T03:19:00.560973+0000","last_fullsized":"2024-09-22T03:19:00.560973+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562358+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:19:00.562358+0000","last_peered":"2024-09-22T03:19:00.562358+0000","last_clean":"2024-09-22T03:19:00.562358+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:19:00.562358+0000","last_undegraded":"2024-09-22T03:19:00.562358+0000","last_fullsized":"2024-09-22T03:19:00.562358+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":355,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.570781+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:19:00.570781+0000","last_peered":"2024-09-22T03:19:00.570781+0000","last_clean":"2024-09-22T03:19:00.570781+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:19:00.570781+0000","last_undegraded":"2024-09-22T03:19:00.570781+0000","last_fullsized":"2024-09-22T03:19:00.570781+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.561236+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:19:00.561236+0000","last_peered":"2024-09-22T03:19:00.561236+0000","last_clean":"2024-09-22T03:19:00.561236+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:19:00.561236+0000","last_undegraded":"2024-09-22T03:19:00.561236+0000","last_fullsized":"2024-09-22T03:19:00.561236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.563322+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:19:00.563322+0000","last_peered":"2024-09-22T03:19:00.563322+0000","last_clean":"2024-09-22T03:19:00.563322+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:19:00.563322+0000","last_undegraded":"2024-09-22T03:19:00.563322+0000","last_fullsized":"2024-09-22T03:19:00.563322+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562819+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:19:00.562819+0000","last_peered":"2024-09-22T03:19:00.562819+0000","last_clean":"2024-09-22T03:19:00.562819+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:19:00.562819+0000","last_undegraded":"2024-09-22T03:19:00.562819+0000","last_fullsized":"2024-09-22T03:19:00.562819+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562357+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:19:00.562357+0000","last_peered":"2024-09-22T03:19:00.562357+0000","last_clean":"2024-09-22T03:19:00.562357+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:19:00.562357+0000","last_undegraded":"2024-09-22T03:19:00.562357+0000","last_fullsized":"2024-09-22T03:19:00.562357+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123968,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":123456,"kb_avail":94247872,"statfs":{"total":96636764160,"available":96509820928,"internally_reserved":0,"allocated":483328,"data_stored":180899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":126418944},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113724,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":113152,"kb_avail":94258116,"statfs":{"total":96636764160,"available":96520310784,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":115867648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123004,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":122432,"kb_avail":94248836,"statfs":{"total":96636764160,"available":96510808064,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":125370368},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37944,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":37376,"kb_avail":94333896,"statfs":{"total":96636764160,"available":96597909504,"internally_reserved":0,"allocated":540672,"data_stored":771248,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":38273024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:19:05.078 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:19:05.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-22T03:19:05.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:05.176+0000 7faf5ca6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:05.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:05.185+0000 7faf5ca6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:05.378 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-22T03:19:05.387 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T03:19:05.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:19:05.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:05.485+0000 7f0fa6597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:05.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:05.492+0000 7f0fa6597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:19:05.671 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:19:05.684 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-22T03:19:04.849548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":398640,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":396416,"kb_avail":377088720,"statfs":{"total":386547056640,"available":386138849280,"internally_reserved":0,"allocated":2113536,"data_stored":2494681,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":405929984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.302850"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560981+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:19:00.560981+0000","last_peered":"2024-09-22T03:19:00.560981+0000","last_clean":"2024-09-22T03:19:00.560981+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:19:00.560981+0000","last_undegraded":"2024-09-22T03:19:00.560981+0000","last_fullsized":"2024-09-22T03:19:00.560981+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.568676+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:19:00.568676+0000","last_peered":"2024-09-22T03:19:00.568676+0000","last_clean":"2024-09-22T03:19:00.568676+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:19:00.568676+0000","last_undegraded":"2024-09-22T03:19:00.568676+0000","last_fullsized":"2024-09-22T03:19:00.568676+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560973+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:19:00.560973+0000","last_peered":"2024-09-22T03:19:00.560973+0000","last_clean":"2024-09-22T03:19:00.560973+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:19:00.560973+0000","last_undegraded":"2024-09-22T03:19:00.560973+0000","last_fullsized":"2024-09-22T03:19:00.560973+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562358+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:19:00.562358+0000","last_peered":"2024-09-22T03:19:00.562358+0000","last_clean":"2024-09-22T03:19:00.562358+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:19:00.562358+0000","last_undegraded":"2024-09-22T03:19:00.562358+0000","last_fullsized":"2024-09-22T03:19:00.562358+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":355,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.570781+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:19:00.570781+0000","last_peered":"2024-09-22T03:19:00.570781+0000","last_clean":"2024-09-22T03:19:00.570781+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:19:00.570781+0000","last_undegraded":"2024-09-22T03:19:00.570781+0000","last_fullsized":"2024-09-22T03:19:00.570781+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.561236+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:19:00.561236+0000","last_peered":"2024-09-22T03:19:00.561236+0000","last_clean":"2024-09-22T03:19:00.561236+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:19:00.561236+0000","last_undegraded":"2024-09-22T03:19:00.561236+0000","last_fullsized":"2024-09-22T03:19:00.561236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.563322+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:19:00.563322+0000","last_peered":"2024-09-22T03:19:00.563322+0000","last_clean":"2024-09-22T03:19:00.563322+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:19:00.563322+0000","last_undegraded":"2024-09-22T03:19:00.563322+0000","last_fullsized":"2024-09-22T03:19:00.563322+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562819+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:19:00.562819+0000","last_peered":"2024-09-22T03:19:00.562819+0000","last_clean":"2024-09-22T03:19:00.562819+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:19:00.562819+0000","last_undegraded":"2024-09-22T03:19:00.562819+0000","last_fullsized":"2024-09-22T03:19:00.562819+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562357+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:19:00.562357+0000","last_peered":"2024-09-22T03:19:00.562357+0000","last_clean":"2024-09-22T03:19:00.562357+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:19:00.562357+0000","last_undegraded":"2024-09-22T03:19:00.562357+0000","last_fullsized":"2024-09-22T03:19:00.562357+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123968,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":123456,"kb_avail":94247872,"statfs":{"total":96636764160,"available":96509820928,"internally_reserved":0,"allocated":483328,"data_stored":180899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":126418944},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113724,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":113152,"kb_avail":94258116,"statfs":{"total":96636764160,"available":96520310784,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":115867648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123004,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":122432,"kb_avail":94248836,"statfs":{"total":96636764160,"available":96510808064,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":125370368},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37944,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":37376,"kb_avail":94333896,"statfs":{"total":96636764160,"available":96597909504,"internally_reserved":0,"allocated":540672,"data_stored":771248,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":38273024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:19:05.685 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:19:05.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:05.782+0000 7fa49eed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:05.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:05.789+0000 7fa49eed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:19:05.968 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:19:05.979 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-22T03:19:04.849548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":398640,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":396416,"kb_avail":377088720,"statfs":{"total":386547056640,"available":386138849280,"internally_reserved":0,"allocated":2113536,"data_stored":2494681,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":405929984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.302850"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560981+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:19:00.560981+0000","last_peered":"2024-09-22T03:19:00.560981+0000","last_clean":"2024-09-22T03:19:00.560981+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:19:00.560981+0000","last_undegraded":"2024-09-22T03:19:00.560981+0000","last_fullsized":"2024-09-22T03:19:00.560981+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.568676+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:19:00.568676+0000","last_peered":"2024-09-22T03:19:00.568676+0000","last_clean":"2024-09-22T03:19:00.568676+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:19:00.568676+0000","last_undegraded":"2024-09-22T03:19:00.568676+0000","last_fullsized":"2024-09-22T03:19:00.568676+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560973+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:19:00.560973+0000","last_peered":"2024-09-22T03:19:00.560973+0000","last_clean":"2024-09-22T03:19:00.560973+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:19:00.560973+0000","last_undegraded":"2024-09-22T03:19:00.560973+0000","last_fullsized":"2024-09-22T03:19:00.560973+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562358+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:19:00.562358+0000","last_peered":"2024-09-22T03:19:00.562358+0000","last_clean":"2024-09-22T03:19:00.562358+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:19:00.562358+0000","last_undegraded":"2024-09-22T03:19:00.562358+0000","last_fullsized":"2024-09-22T03:19:00.562358+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":355,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.570781+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:19:00.570781+0000","last_peered":"2024-09-22T03:19:00.570781+0000","last_clean":"2024-09-22T03:19:00.570781+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:19:00.570781+0000","last_undegraded":"2024-09-22T03:19:00.570781+0000","last_fullsized":"2024-09-22T03:19:00.570781+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.561236+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:19:00.561236+0000","last_peered":"2024-09-22T03:19:00.561236+0000","last_clean":"2024-09-22T03:19:00.561236+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:19:00.561236+0000","last_undegraded":"2024-09-22T03:19:00.561236+0000","last_fullsized":"2024-09-22T03:19:00.561236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.563322+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:19:00.563322+0000","last_peered":"2024-09-22T03:19:00.563322+0000","last_clean":"2024-09-22T03:19:00.563322+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:19:00.563322+0000","last_undegraded":"2024-09-22T03:19:00.563322+0000","last_fullsized":"2024-09-22T03:19:00.563322+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562819+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:19:00.562819+0000","last_peered":"2024-09-22T03:19:00.562819+0000","last_clean":"2024-09-22T03:19:00.562819+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:19:00.562819+0000","last_undegraded":"2024-09-22T03:19:00.562819+0000","last_fullsized":"2024-09-22T03:19:00.562819+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562357+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:19:00.562357+0000","last_peered":"2024-09-22T03:19:00.562357+0000","last_clean":"2024-09-22T03:19:00.562357+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:19:00.562357+0000","last_undegraded":"2024-09-22T03:19:00.562357+0000","last_fullsized":"2024-09-22T03:19:00.562357+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123968,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":123456,"kb_avail":94247872,"statfs":{"total":96636764160,"available":96509820928,"internally_reserved":0,"allocated":483328,"data_stored":180899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":126418944},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113724,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":113152,"kb_avail":94258116,"statfs":{"total":96636764160,"available":96520310784,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":115867648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123004,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":122432,"kb_avail":94248836,"statfs":{"total":96636764160,"available":96510808064,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":125370368},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37944,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":37376,"kb_avail":94333896,"statfs":{"total":96636764160,"available":96597909504,"internally_reserved":0,"allocated":540672,"data_stored":771248,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":38273024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:19:05.980 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T03:19:05.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:19:06.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:06.077+0000 7f7cfd597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:06.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:06.083+0000 7f7cfd597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:19:06.260 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:19:06.272 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-22T03:19:04.849548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":398640,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":396416,"kb_avail":377088720,"statfs":{"total":386547056640,"available":386138849280,"internally_reserved":0,"allocated":2113536,"data_stored":2494681,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":405929984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.302850"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560981+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:19:00.560981+0000","last_peered":"2024-09-22T03:19:00.560981+0000","last_clean":"2024-09-22T03:19:00.560981+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:19:00.560981+0000","last_undegraded":"2024-09-22T03:19:00.560981+0000","last_fullsized":"2024-09-22T03:19:00.560981+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.568676+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:19:00.568676+0000","last_peered":"2024-09-22T03:19:00.568676+0000","last_clean":"2024-09-22T03:19:00.568676+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:19:00.568676+0000","last_undegraded":"2024-09-22T03:19:00.568676+0000","last_fullsized":"2024-09-22T03:19:00.568676+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560973+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:19:00.560973+0000","last_peered":"2024-09-22T03:19:00.560973+0000","last_clean":"2024-09-22T03:19:00.560973+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:19:00.560973+0000","last_undegraded":"2024-09-22T03:19:00.560973+0000","last_fullsized":"2024-09-22T03:19:00.560973+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562358+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:19:00.562358+0000","last_peered":"2024-09-22T03:19:00.562358+0000","last_clean":"2024-09-22T03:19:00.562358+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:19:00.562358+0000","last_undegraded":"2024-09-22T03:19:00.562358+0000","last_fullsized":"2024-09-22T03:19:00.562358+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":355,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.570781+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:19:00.570781+0000","last_peered":"2024-09-22T03:19:00.570781+0000","last_clean":"2024-09-22T03:19:00.570781+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:19:00.570781+0000","last_undegraded":"2024-09-22T03:19:00.570781+0000","last_fullsized":"2024-09-22T03:19:00.570781+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.561236+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:19:00.561236+0000","last_peered":"2024-09-22T03:19:00.561236+0000","last_clean":"2024-09-22T03:19:00.561236+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:19:00.561236+0000","last_undegraded":"2024-09-22T03:19:00.561236+0000","last_fullsized":"2024-09-22T03:19:00.561236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.563322+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:19:00.563322+0000","last_peered":"2024-09-22T03:19:00.563322+0000","last_clean":"2024-09-22T03:19:00.563322+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:19:00.563322+0000","last_undegraded":"2024-09-22T03:19:00.563322+0000","last_fullsized":"2024-09-22T03:19:00.563322+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562819+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:19:00.562819+0000","last_peered":"2024-09-22T03:19:00.562819+0000","last_clean":"2024-09-22T03:19:00.562819+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:19:00.562819+0000","last_undegraded":"2024-09-22T03:19:00.562819+0000","last_fullsized":"2024-09-22T03:19:00.562819+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562357+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:19:00.562357+0000","last_peered":"2024-09-22T03:19:00.562357+0000","last_clean":"2024-09-22T03:19:00.562357+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:19:00.562357+0000","last_undegraded":"2024-09-22T03:19:00.562357+0000","last_fullsized":"2024-09-22T03:19:00.562357+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123968,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":123456,"kb_avail":94247872,"statfs":{"total":96636764160,"available":96509820928,"internally_reserved":0,"allocated":483328,"data_stored":180899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":126418944},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113724,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":113152,"kb_avail":94258116,"statfs":{"total":96636764160,"available":96520310784,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":115867648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123004,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":122432,"kb_avail":94248836,"statfs":{"total":96636764160,"available":96510808064,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":125370368},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37944,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":37376,"kb_avail":94333896,"statfs":{"total":96636764160,"available":96597909504,"internally_reserved":0,"allocated":540672,"data_stored":771248,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":38273024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:19:06.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:19:06.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:06.370+0000 7f0abab97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:06.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:06.377+0000 7f0abab97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:19:06.557 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":85,"fsid":"3c083707-cce1-453e-8e70-29f18e875f9d","created":"2024-09-22T03:04:08.385553+0000","modified":"2024-09-22T03:19:00.551167+0000","last_up_change":"2024-09-22T03:04:16.701908+0000","last_in_change":"2024-09-22T03:04:10.540409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-22T03:04:18.643341+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-09-22T03:04:18.723036+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff5d97d6-a2e2-418e-bafc-bb5c698ac90b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":3237802792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3237802792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":3237802792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3237802792}]},"public_addr":"172.21.15.134:6801/3237802792","cluster_addr":"172.21.15.134:6802/3237802792","heartbeat_back_addr":"172.21.15.134:6805/3237802792","heartbeat_front_addr":"172.21.15.134:6806/3237802792","state":["exists","up"]},{"osd":1,"uuid":"a8e1b061-b453-4df2-adaa-7d0dbfd1b5b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2010837962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2010837962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":2010837962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2010837962}]},"public_addr":"172.21.15.134:6804/2010837962","cluster_addr":"172.21.15.134:6807/2010837962","heartbeat_back_addr":"172.21.15.134:6809/2010837962","heartbeat_front_addr":"172.21.15.134:6808/2010837962","state":["exists","up"]},{"osd":2,"uuid":"9bcfb0f2-be7f-4950-a879-546f296b63cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":2068530255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2068530255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6809","nonce":2068530255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2068530255}]},"public_addr":"172.21.15.139:6805/2068530255","cluster_addr":"172.21.15.139:6804/2068530255","heartbeat_back_addr":"172.21.15.139:6809/2068530255","heartbeat_front_addr":"172.21.15.139:6808/2068530255","state":["exists","up"]},{"osd":3,"uuid":"593b511d-7c06-4d5e-83e2-d89568e0666b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6803","nonce":2508851681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2508851681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2508851681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":2508851681}]},"public_addr":"172.21.15.139:6803/2508851681","cluster_addr":"172.21.15.139:6802/2508851681","heartbeat_back_addr":"172.21.15.139:6812/2508851681","heartbeat_front_addr":"172.21.15.139:6811/2508851681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:19:07.571 INFO:tasks.ceph:Scrubbing osd.0 2024-09-22T03:19:07.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-22T03:19:07.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:07.682+0000 7ff5b4d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:07.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:07.692+0000 7ff5b4d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:07.707 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-22T03:19:07.707 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "" 2024-09-22T03:19:07.707 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-22T03:19:07.718 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-22T03:19:07.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:07.815+0000 7f4fc70a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:07.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:07.823+0000 7f4fc70a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:08.025 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 0 to deep-scrub 2024-09-22T03:19:08.043 INFO:tasks.ceph:Scrubbing osd.1 2024-09-22T03:19:08.043 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-22T03:19:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:08.144+0000 7f27ce2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:08.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:08.154+0000 7f27ce2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:08.168 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-22T03:19:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "" 2024-09-22T03:19:08.169 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-22T03:19:08.180 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-22T03:19:08.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:08.277+0000 7fa1fc42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:08.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:08.285+0000 7fa1fc42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:08.463 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 1 to deep-scrub 2024-09-22T03:19:08.477 INFO:tasks.ceph:Scrubbing osd.2 2024-09-22T03:19:08.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-22T03:19:08.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:08.576+0000 7f292dea9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:08.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:08.587+0000 7f292dea9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:08.603 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-22T03:19:08.603 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "" 2024-09-22T03:19:08.603 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-22T03:19:08.614 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-22T03:19:08.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:08.711+0000 7f1669e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:08.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:08.719+0000 7f1669e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:08.899 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 2 to deep-scrub 2024-09-22T03:19:08.914 INFO:tasks.ceph:Scrubbing osd.3 2024-09-22T03:19:08.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-22T03:19:09.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:09.012+0000 7f46f2317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:09.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:09.022+0000 7f46f2317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:09.038 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-22T03:19:09.038 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "" 2024-09-22T03:19:09.038 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-22T03:19:09.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-22T03:19:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:09.147+0000 7f180eed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:09.154+0000 7f180eed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 3 to deep-scrub 2024-09-22T03:19:09.422 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:19:09.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:09.522+0000 7fca84d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:09.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:09.528+0000 7fca84d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:09.707 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:19:09.707 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:19:09.720 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":524,"stamp":"2024-09-22T03:19:08.850570+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":398640,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":396416,"kb_avail":377088720,"statfs":{"total":386547056640,"available":386138849280,"internally_reserved":0,"allocated":2113536,"data_stored":2494681,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":405929984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.303002"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560981+0000","last_change":"2024-09-22T03:04:21.742303+0000","last_active":"2024-09-22T03:19:00.560981+0000","last_peered":"2024-09-22T03:19:00.560981+0000","last_clean":"2024-09-22T03:19:00.560981+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:19:00.560981+0000","last_undegraded":"2024-09-22T03:19:00.560981+0000","last_fullsized":"2024-09-22T03:19:00.560981+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.568676+0000","last_change":"2024-09-22T03:04:21.742813+0000","last_active":"2024-09-22T03:19:00.568676+0000","last_peered":"2024-09-22T03:19:00.568676+0000","last_clean":"2024-09-22T03:19:00.568676+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:19:00.568676+0000","last_undegraded":"2024-09-22T03:19:00.568676+0000","last_fullsized":"2024-09-22T03:19:00.568676+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.560973+0000","last_change":"2024-09-22T03:04:21.743308+0000","last_active":"2024-09-22T03:19:00.560973+0000","last_peered":"2024-09-22T03:19:00.560973+0000","last_clean":"2024-09-22T03:19:00.560973+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:19:00.560973+0000","last_undegraded":"2024-09-22T03:19:00.560973+0000","last_fullsized":"2024-09-22T03:19:00.560973+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562358+0000","last_change":"2024-09-22T03:04:21.744697+0000","last_active":"2024-09-22T03:19:00.562358+0000","last_peered":"2024-09-22T03:19:00.562358+0000","last_clean":"2024-09-22T03:19:00.562358+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:19:00.562358+0000","last_undegraded":"2024-09-22T03:19:00.562358+0000","last_fullsized":"2024-09-22T03:19:00.562358+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":355,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.570781+0000","last_change":"2024-09-22T03:04:19.794050+0000","last_active":"2024-09-22T03:19:00.570781+0000","last_peered":"2024-09-22T03:19:00.570781+0000","last_clean":"2024-09-22T03:19:00.570781+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:19:00.570781+0000","last_undegraded":"2024-09-22T03:19:00.570781+0000","last_fullsized":"2024-09-22T03:19:00.570781+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.561236+0000","last_change":"2024-09-22T03:04:21.743650+0000","last_active":"2024-09-22T03:19:00.561236+0000","last_peered":"2024-09-22T03:19:00.561236+0000","last_clean":"2024-09-22T03:19:00.561236+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:19:00.561236+0000","last_undegraded":"2024-09-22T03:19:00.561236+0000","last_fullsized":"2024-09-22T03:19:00.561236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.563322+0000","last_change":"2024-09-22T03:04:21.744374+0000","last_active":"2024-09-22T03:19:00.563322+0000","last_peered":"2024-09-22T03:19:00.563322+0000","last_clean":"2024-09-22T03:19:00.563322+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:19:00.563322+0000","last_undegraded":"2024-09-22T03:19:00.563322+0000","last_fullsized":"2024-09-22T03:19:00.563322+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562819+0000","last_change":"2024-09-22T03:04:21.746621+0000","last_active":"2024-09-22T03:19:00.562819+0000","last_peered":"2024-09-22T03:19:00.562819+0000","last_clean":"2024-09-22T03:19:00.562819+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:19:00.562819+0000","last_undegraded":"2024-09-22T03:19:00.562819+0000","last_fullsized":"2024-09-22T03:19:00.562819+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:00.562357+0000","last_change":"2024-09-22T03:04:21.746358+0000","last_active":"2024-09-22T03:19:00.562357+0000","last_peered":"2024-09-22T03:19:00.562357+0000","last_clean":"2024-09-22T03:19:00.562357+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:19:00.562357+0000","last_undegraded":"2024-09-22T03:19:00.562357+0000","last_fullsized":"2024-09-22T03:19:00.562357+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:04:18.723355+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123968,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":123456,"kb_avail":94247872,"statfs":{"total":96636764160,"available":96509820928,"internally_reserved":0,"allocated":483328,"data_stored":180899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":126418944},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113724,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":113152,"kb_avail":94258116,"statfs":{"total":96636764160,"available":96520310784,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":115867648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123004,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":122432,"kb_avail":94248836,"statfs":{"total":96636764160,"available":96510808064,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":125370368},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37944,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":37376,"kb_avail":94333896,"statfs":{"total":96636764160,"available":96597909504,"internally_reserved":0,"allocated":540672,"data_stored":771248,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":38273024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:19:09.723 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-22T03:04:18.723355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=4, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=19, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:19:09.723 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-09-22T03:04:18.723355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=4, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=19, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:19:09.723 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-09-22T03:04:18.723355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=4, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=19, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:19:09.723 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-09-22T03:04:18.723355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=4, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=19, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:19:09.723 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-22T03:04:18.723355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=4, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=19, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:19:09.723 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-09-22T03:04:18.723355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=4, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=19, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:19:09.723 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-09-22T03:04:18.723355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=4, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=19, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:19:09.723 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-09-22T03:04:18.723355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=4, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=19, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:19:09.724 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-09-22T03:04:18.723355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=4, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=19, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:19:09.724 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T03:19:29.725 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:19:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:29.837+0000 7fd25c997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:29.844+0000 7fd25c997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-22T03:19:30.020 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-22T03:19:30.033 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":534,"stamp":"2024-09-22T03:19:28.854742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":398640,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":396416,"kb_avail":377088720,"statfs":{"total":386547056640,"available":386138849280,"internally_reserved":0,"allocated":2113536,"data_stored":2494681,"data_compressed":89880,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":405929984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002471"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:09.333566+0000","last_change":"2024-09-22T03:19:09.339760+0000","last_active":"2024-09-22T03:19:09.333566+0000","last_peered":"2024-09-22T03:19:09.333566+0000","last_clean":"2024-09-22T03:19:09.333566+0000","last_became_active":"2024-09-22T03:04:19.770121+0000","last_became_peered":"2024-09-22T03:04:19.770121+0000","last_unstale":"2024-09-22T03:19:09.333566+0000","last_undegraded":"2024-09-22T03:19:09.333566+0000","last_fullsized":"2024-09-22T03:19:09.333566+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:19:09.339642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:19:09.339642+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:08.025779+0000","last_change":"2024-09-22T03:19:08.032299+0000","last_active":"2024-09-22T03:19:08.025779+0000","last_peered":"2024-09-22T03:19:08.025779+0000","last_clean":"2024-09-22T03:19:08.025779+0000","last_became_active":"2024-09-22T03:04:19.783401+0000","last_became_peered":"2024-09-22T03:04:19.783401+0000","last_unstale":"2024-09-22T03:19:08.025779+0000","last_undegraded":"2024-09-22T03:19:08.025779+0000","last_fullsized":"2024-09-22T03:19:08.025779+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:19:08.032205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:19:08.032205+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":233,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:08.900247+0000","last_change":"2024-09-22T03:19:08.908694+0000","last_active":"2024-09-22T03:19:08.900247+0000","last_peered":"2024-09-22T03:19:08.900247+0000","last_clean":"2024-09-22T03:19:08.900247+0000","last_became_active":"2024-09-22T03:04:19.791374+0000","last_became_peered":"2024-09-22T03:04:19.791374+0000","last_unstale":"2024-09-22T03:19:08.900247+0000","last_undegraded":"2024-09-22T03:19:08.900247+0000","last_fullsized":"2024-09-22T03:19:08.900247+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2024-09-22T03:19:08.908562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:19:08.908562+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":232,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:09.333634+0000","last_change":"2024-09-22T03:19:09.439181+0000","last_active":"2024-09-22T03:19:09.333634+0000","last_peered":"2024-09-22T03:19:09.333634+0000","last_clean":"2024-09-22T03:19:09.333634+0000","last_became_active":"2024-09-22T03:04:19.782884+0000","last_became_peered":"2024-09-22T03:04:19.782884+0000","last_unstale":"2024-09-22T03:19:09.333634+0000","last_undegraded":"2024-09-22T03:19:09.333634+0000","last_fullsized":"2024-09-22T03:19:09.333634+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'1","last_scrub_stamp":"2024-09-22T03:19:09.439032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:19:09.439032+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":357,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:08.026538+0000","last_change":"2024-09-22T03:19:08.090819+0000","last_active":"2024-09-22T03:19:08.026538+0000","last_peered":"2024-09-22T03:19:08.026538+0000","last_clean":"2024-09-22T03:19:08.026538+0000","last_became_active":"2024-09-22T03:04:19.786420+0000","last_became_peered":"2024-09-22T03:04:19.786420+0000","last_unstale":"2024-09-22T03:19:08.026538+0000","last_undegraded":"2024-09-22T03:19:08.026538+0000","last_fullsized":"2024-09-22T03:19:08.026538+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'97","last_scrub_stamp":"2024-09-22T03:19:08.090647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:19:08.090647+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:08.463365+0000","last_change":"2024-09-22T03:19:08.471051+0000","last_active":"2024-09-22T03:19:08.463365+0000","last_peered":"2024-09-22T03:19:08.463365+0000","last_clean":"2024-09-22T03:19:08.463365+0000","last_became_active":"2024-09-22T03:04:19.776124+0000","last_became_peered":"2024-09-22T03:04:19.776124+0000","last_unstale":"2024-09-22T03:19:08.463365+0000","last_undegraded":"2024-09-22T03:19:08.463365+0000","last_fullsized":"2024-09-22T03:19:08.463365+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:19:08.470956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:19:08.470956+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:08.901069+0000","last_change":"2024-09-22T03:19:08.907028+0000","last_active":"2024-09-22T03:19:08.901069+0000","last_peered":"2024-09-22T03:19:08.901069+0000","last_clean":"2024-09-22T03:19:08.901069+0000","last_became_active":"2024-09-22T03:04:19.773531+0000","last_became_peered":"2024-09-22T03:04:19.773531+0000","last_unstale":"2024-09-22T03:19:08.901069+0000","last_undegraded":"2024-09-22T03:19:08.901069+0000","last_fullsized":"2024-09-22T03:19:08.901069+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:19:08.906812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:19:08.906812+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:08.464202+0000","last_change":"2024-09-22T03:19:08.471564+0000","last_active":"2024-09-22T03:19:08.464202+0000","last_peered":"2024-09-22T03:19:08.464202+0000","last_clean":"2024-09-22T03:19:08.464202+0000","last_became_active":"2024-09-22T03:04:19.778675+0000","last_became_peered":"2024-09-22T03:04:19.778675+0000","last_unstale":"2024-09-22T03:19:08.464202+0000","last_undegraded":"2024-09-22T03:19:08.464202+0000","last_fullsized":"2024-09-22T03:19:08.464202+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:19:08.471484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:19:08.471484+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-22T03:19:08.464740+0000","last_change":"2024-09-22T03:19:08.525032+0000","last_active":"2024-09-22T03:19:08.464740+0000","last_peered":"2024-09-22T03:19:08.464740+0000","last_clean":"2024-09-22T03:19:08.464740+0000","last_became_active":"2024-09-22T03:04:19.788777+0000","last_became_peered":"2024-09-22T03:04:19.788777+0000","last_unstale":"2024-09-22T03:19:08.464740+0000","last_undegraded":"2024-09-22T03:19:08.464740+0000","last_fullsized":"2024-09-22T03:19:08.464740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:19:08.524843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:19:08.524843+0000","last_clean_scrub_stamp":"2024-09-22T03:04:18.723355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123968,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":123456,"kb_avail":94247872,"statfs":{"total":96636764160,"available":96509820928,"internally_reserved":0,"allocated":483328,"data_stored":180899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":126418944},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113724,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":113152,"kb_avail":94258116,"statfs":{"total":96636764160,"available":96520310784,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":115867648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123004,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":122432,"kb_avail":94248836,"statfs":{"total":96636764160,"available":96510808064,"internally_reserved":0,"allocated":544768,"data_stored":771267,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":125370368},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706573,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37944,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":37376,"kb_avail":94333896,"statfs":{"total":96636764160,"available":96597909504,"internally_reserved":0,"allocated":540672,"data_stored":771248,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":38273024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29960,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:19:30.034 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-22T03:19:30.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:30.129+0000 7faa28f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:30.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-22T03:19:30.138+0000 7faa28f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:19:30.335 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-22T03:19:30.335 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-22T03:19:30.335 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-22T03:19:30.335 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:19:30.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-22T03:19:36.437 INFO:tasks.ceph.osd.0:Stopped 2024-09-22T03:19:36.437 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-22T03:19:36.437 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:19:36.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-09-22T03:19:41.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-22T03:19:41.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-22T03:19:42.539 INFO:tasks.ceph.osd.1:Stopped 2024-09-22T03:19:42.540 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-22T03:19:42.540 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:19:47.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-22T03:19:47.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-22T03:19:48.642 INFO:tasks.ceph.osd.2:Stopped 2024-09-22T03:19:48.642 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-22T03:19:48.642 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:19:52.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-22T03:19:52.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-22T03:19:54.744 INFO:tasks.ceph.osd.3:Stopped 2024-09-22T03:19:54.744 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-22T03:19:54.744 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-22T03:19:54.744 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:19:54.777 INFO:tasks.ceph.mgr.x:Stopped 2024-09-22T03:19:54.777 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-22T03:19:54.777 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-22T03:19:54.777 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:19:54.792 INFO:tasks.ceph.mon.a:Stopped 2024-09-22T03:19:54.792 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-22T03:19:54.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-22T03:19:54.871 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-22T03:19:54.872 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-22T03:19:55.053 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-22T03:19:55.054 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-22T03:19:55.134 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-22T03:19:55.135 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-22T03:19:55.285 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-22T03:19:55.285 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-22T03:19:55.363 INFO:tasks.ceph:Archiving mon data... 2024-09-22T03:19:55.364 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914719/data/mon.a.tgz 2024-09-22T03:19:55.364 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-22T03:19:55.381 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.oA9OGX4e6f 2024-09-22T03:19:55.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.oA9OGX4e6f 2024-09-22T03:19:55.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.oA9OGX4e6f 2024-09-22T03:19:55.582 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.oA9OGX4e6f is 229KB 2024-09-22T03:19:55.675 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.oA9OGX4e6f 2024-09-22T03:19:55.690 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-22T03:19:55.690 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T03:19:55.732 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T03:19:55.810 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T03:19:55.827 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T03:19:55.827 INFO:tasks.ceph:Archiving crash dumps... 2024-09-22T03:19:55.829 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914719/remote/smithi134/crash 2024-09-22T03:19:55.829 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T03:19:55.874 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914719/remote/smithi139/crash 2024-09-22T03:19:55.875 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T03:19:55.915 INFO:tasks.ceph:Compressing logs... 2024-09-22T03:19:55.916 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T03:19:55.919 DEBUG:teuthology.orchestra.run.smithi139:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T03:19:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-22T03:19:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33982.log 2024-09-22T03:19:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55762.log 2024-09-22T03:19:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56288.log 2024-09-22T03:19:55.942 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33982.log.gz 2024-09-22T03:19:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51660.log 2024-09-22T03:19:55.942 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55762.log.gz 2024-09-22T03:19:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56288.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56288.log.gz 2024-09-22T03:19:55.943 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33025.log 2024-09-22T03:19:55.990 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34436.log 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51660.log.gz 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44163.log 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33025.log.gz 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30884.log 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34436.log.gz 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50582.log 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44163.log.gz 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66817.log 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30884.log.gz 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36266.log 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50582.log.gz 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66817.log: gzip 50.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.66817.log.gz --verbose 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.67069.log 2024-09-22T03:19:55.991 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57988.log 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36266.log.gz 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37440.log 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67069.log.gz 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50324.log 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57988.log.gz 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55612.log 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37440.log.gz 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61890.log 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.50324.log.gz 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58931.log 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55612.log.gz 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43623.log 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61890.log.gz 2024-09-22T03:19:55.992 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50228.log 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58931.log.gz 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55403.log 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43623.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43623.log.gz 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50228.log: gzip 49.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.50228.log.gz -- 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.54200.log 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41396.log 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55403.log.gz 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29996.log 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54200.log.gz 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44841.log 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41396.log.gz 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65245.log 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29996.log.gz 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40065.log 2024-09-22T03:19:55.993 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44841.log.gz 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58037.log 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65245.log.gz 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38419.log 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40065.log.gz 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43672.log 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58037.log.gz 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55116.log 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38419.log.gz 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36953.log 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43672.log.gz 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34257.log 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55116.log.gz 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38146.log 2024-09-22T03:19:55.994 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36953.log.gz 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47914.log 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34257.log.gz 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34527.log 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38146.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38146.log.gz 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48914.log 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47914.log.gz 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39298.log 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34527.log.gz 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49401.log 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48914.log.gz 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47853.log 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39298.log.gz 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32200.log 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49401.log.gz 2024-09-22T03:19:55.995 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34281.log 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47853.log.gz 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51331.log 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32200.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32200.log.gz 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.34281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63632.log 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64185.log 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51331.log.gz 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53942.log 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63632.log.gz 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33688.log 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64185.log.gz 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47373.log 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.53942.log.gz 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40550.log 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33688.log.gz 2024-09-22T03:19:55.996 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42448.log 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47373.log.gz 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66522.log 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40550.log.gz 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31802.log 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.42448.log.gz 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59418.log 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66522.log.gz 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36735.log 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31802.log.gz 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29033.log 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59418.log.gz 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51918.log 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36735.log.gz 2024-09-22T03:19:55.997 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34207.log 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29033.log.gz 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36218.log 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51918.log.gz 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43368.log 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34207.log.gz 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33738.log 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36218.log.gz 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35532.log 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43368.log.gz 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61213.log 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33738.log.gz 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29623.log 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35532.log.gz 2024-09-22T03:19:55.998 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63114.log 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61213.log.gz 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32249.log 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29623.log.gz 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65205.log/var/log/ceph/ceph-client.admin.63114.log: 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63114.log.gz 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47497.log 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32249.log.gz 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38949.log 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65205.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65205.log.gz 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43304.log 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47497.log.gz 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38949.log: gzip 50.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.38949.log.gz --verbose 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.54438.log 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38851.log 2024-09-22T03:19:55.999 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43304.log.gz 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54438.log: gzip 47.6% -- replaced with /var/log/ceph/ceph-client.admin.54438.log.gz -5 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46981.log 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49521.log 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38851.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38851.log.gz 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48329.log 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46981.log.gz 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65808.log 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49521.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49521.log.gz 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39536.log 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48329.log.gz 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52839.log 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65808.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65808.log.gz 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39536.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27138.log 2024-09-22T03:19:56.000 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39536.log.gz 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52888.log 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52839.log.gz 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.tmp-client.admin.27138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45148.log 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr: 68.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27138.log.gz 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49221.log 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.52888.log.gz 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33862.log 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45148.log.gz 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38097.log 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49221.log.gz 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33862.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33862.log.gz 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58504.log 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30253.log 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38097.log.gz 2024-09-22T03:19:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58504.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58504.log.gz 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31753.log 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65908.log 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30253.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30253.log.gz 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60152.log 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.31753.log.gz 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46263.log 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65908.log.gz 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51051.log 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.60152.log.gz 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48865.log 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46263.log.gz 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51051.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.51051.log.gz 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62885.log 2024-09-22T03:19:56.002 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58971.log 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48865.log.gz 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50960.log 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62885.log.gz 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32031.log 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58971.log.gz 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50960.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59983.log 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50960.log.gz 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65907.log 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32031.log.gz 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64987.log 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59983.log.gz 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48816.log 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65907.log.gz 2024-09-22T03:19:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62485.log 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64987.log.gz 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48467.log 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48816.log.gz 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35136.log 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62485.log.gz 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61612.log 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48467.log.gz 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35136.log: gzip -5 49.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.35136.log.gz -- 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.33145.log 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56388.log 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61612.log.gz 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33145.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.33145.log.gz --verbose 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.66225.log 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-22T03:19:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56388.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56388.log.gz 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66225.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.66225.log.gz 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46343.log 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60459.log 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46343.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46343.log.gz 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50373.log 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39885.log 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60459.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60459.log.gz 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34576.log 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50373.log.gz 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54816.log 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39885.log.gz 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66985.log 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34576.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34576.log.gz 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60947.log 2024-09-22T03:19:56.005 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54816.log.gz 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65296.log 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66985.log.gz 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65766.log 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60947.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60947.log.gz 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65296.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65296.log.gz 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47110.log 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41416.log 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65766.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65766.log.gz 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59189.log 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47110.log.gz 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37231.log 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41416.log.gz 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59189.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59189.log.gz -5 2024-09-22T03:19:56.006 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34071.log 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30437.log 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37231.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37231.log.gz 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34071.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.34071.log.gz 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64947.log 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31604.log 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30437.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30437.log.gz 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42310.log 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64947.log.gz 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59538.log 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31604.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31604.log.gz 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40344.log 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42310.log.gz 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42508.log 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.59538.log.gz 2024-09-22T03:19:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30744.log 49.6% 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40344.log.gz 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42150.log 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42508.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42508.log.gz 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57192.log 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30744.log.gz 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62416.log 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42150.log.gz 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61039.log 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57192.log.gz 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62716.log 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62416.log.gz 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61661.log 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61039.log.gz 2024-09-22T03:19:56.008 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50413.log 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62716.log.gz 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32618.log 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61661.log.gz 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54040.log 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50413.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50413.log.gz 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32618.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.32618.log.gz --verbose 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.29435.log 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57619.log 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54040.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54040.log.gz 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40283.log 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29435.log.gz 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45627.log 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57619.log.gz 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.40283.log: /var/log/ceph/ceph-client.admin.36157.log 2024-09-22T03:19:56.009 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40283.log.gz 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55968.log 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45627.log.gz 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60508.log 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.36157.log.gz 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39487.log 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55968.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55968.log.gz 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30302.log 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60508.log.gz 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44583.log 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39487.log.gz 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33822.log 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30302.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30302.log.gz 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58206.log 2024-09-22T03:19:56.010 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44583.log.gz 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49928.log 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33822.log.gz 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63352.log 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58206.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58206.log.gz 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49928.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49928.log.gz 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41536.log 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33554.log 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63352.log.gz 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44114.log 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41536.log.gz 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43754.log 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33554.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33554.log.gz 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59676.log 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44114.log.gz 2024-09-22T03:19:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44672.log 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43754.log.gz 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34905.log 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59676.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59676.log.gz 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44672.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44672.log.gz 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60906.log 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37928.log 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34905.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34905.log.gz 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60906.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60906.log.gz 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65598.log 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29031.log 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37928.log.gz 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65598.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.65598.log.gz 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61262.log 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42795.log 2024-09-22T03:19:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29031.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29031.log.gz 2024-09-22T03:19:56.013 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32847.log 2024-09-22T03:19:56.013 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61262.log.gz 2024-09-22T03:19:56.017 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27999.log 2024-09-22T03:19:56.017 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28039.log 2024-09-22T03:19:56.017 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27912.log 2024-09-22T03:19:56.017 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.27999.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27999.log.gz 2024-09-22T03:19:56.017 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.28039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27959.log 2024-09-22T03:19:56.017 INFO:teuthology.orchestra.run.smithi139.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28039.log.gz 2024-09-22T03:19:56.017 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.27912.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-22T03:19:56.017 INFO:teuthology.orchestra.run.smithi139.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27912.log.gz 2024-09-22T03:19:56.017 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.27959.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-22T03:19:56.018 INFO:teuthology.orchestra.run.smithi139.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.27959.log.gz 2024-09-22T03:19:56.018 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-22T03:19:56.109 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-osd.3.log: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-22T03:19:56.244 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63533.log 2024-09-22T03:19:56.244 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42795.log.gz 2024-09-22T03:19:56.244 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35045.log 2024-09-22T03:19:56.244 INFO:teuthology.orchestra.run.smithi134.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.32847.log.gz 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37271.log 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63533.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63533.log.gz 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36097.log 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35045.log.gz 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59280.log 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37271.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37271.log.gz 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31713.log 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36097.log.gz 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62149.log 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59280.log.gz 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54936.log 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31713.log.gz 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46134.log 2024-09-22T03:19:56.245 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62149.log.gz 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40105.log 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54936.log.gz 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr:gzip/var/log/ceph/ceph-client.admin.46134.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66943.log 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46134.log.gz 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40105.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40105.log.gz 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39129.log 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47239.log 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66943.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66943.log.gz 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34031.log 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39129.log.gz 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66076.log 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47239.log.gz 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42101.log 2024-09-22T03:19:56.246 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34031.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34031.log.gz 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46485.log 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66076.log.gz 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57143.log 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42101.log.gz 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64569.log 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46485.log.gz 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56695.log 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.57143.log.gz 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38536.log 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64569.log.gz 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63023.log 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56695.log.gz 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.38536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50066.log 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29860.log 2024-09-22T03:19:56.247 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63023.log.gz 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42617.log 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50066.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50066.log.gz 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39756.log 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29860.log.gz 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40690.log 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42617.log.gz 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57757.log 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39756.log.gz 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35443.log 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40690.log.gz 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56010.log 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57757.log.gz 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38900.log 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35443.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35443.log.gz 2024-09-22T03:19:56.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40810.log 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56010.log.gz 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38900.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38900.log.gz 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.57937.log 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40810.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40810.log.gz 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46036.log 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57937.log: gzip -5 50.4% -- replaced with /var/log/ceph/ceph-client.admin.57937.log.gz 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57848.log 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46036.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46036.log.gz 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64618.log 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57848.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57848.log.gz 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66312.log 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64618.log: gzip 50.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.61970.log 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64618.log.gz 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32578.log 2024-09-22T03:19:56.249 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66312.log.gz 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48607.log 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61970.log.gz 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37133.log 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32578.log: gzip -5/var/log/ceph/ceph-client.admin.48607.log: --verbose 49.6% -- /var/log/ceph/ceph-client.admin.38991.log 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32578.log.gz 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48607.log.gz 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39089.log 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37133.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37133.log.gz 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43794.log 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38991.log.gz 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39089.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39089.log.gz 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.63772.log 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43794.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43794.log.gz 2024-09-22T03:19:56.250 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58553.log 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63772.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63772.log.gz 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53287.log 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41745.log 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58553.log.gz 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58384.log 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53287.log.gz 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42190.log 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41745.log.gz 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31355.log 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58384.log.gz 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65556.log 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42190.log.gz 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49570.log 2024-09-22T03:19:56.251 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31355.log.gz 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37754.log 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65556.log.gz 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53266.log 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49570.log.gz 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37754.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37754.log.gz 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.40998.log 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53266.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38166.log 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53266.log.gz 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48289.log 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40998.log.gz 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41665.log 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38166.log.gz 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48289.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.48289.log.gz 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33105.log 2024-09-22T03:19:56.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41665.log: gzip -5 --verbose -- 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41665.log.gz 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.46744.log 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33105.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33105.log.gz 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58643.log 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46744.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46744.log.gz 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36364.log 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58643.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.52790.log 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58643.log.gz 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36364.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31544.log 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36364.log.gz 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49968.log 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52790.log.gz 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28761.log 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31544.log.gz 2024-09-22T03:19:56.253 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49968.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49968.log.gz 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38335.log 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28761.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28761.log.gz 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66352.log 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38335.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38335.log.gz 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62805.log 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66352.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66352.log.gz 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64660.log 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62805.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62805.log.gz 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38376.log 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64660.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64660.log.gz 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60808.log 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38376.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38376.log.gz 2024-09-22T03:19:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31446.log 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60808.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60808.log.gz 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43105.log 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31446.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31446.log.gz 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46583.log 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43105.log: gzip -5 --verbose 50.0% -- /var/log/ceph/ceph-client.admin.60281.log 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43105.log.gz 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60063.log 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46583.log.gz 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32887.log 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60281.log.gz 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38462.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60063.log.gz 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32887.log: gzip 50.0% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.32887.log.gz /var/log/ceph/ceph-client.admin.30213.log 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38462.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38462.log.gz 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.60588.log 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30213.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30213.log.gz 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29351.log 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60588.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60588.log.gz 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33514.log 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66775.log 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29351.log.gz 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33514.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33514.log.gz 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.32529.log 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66775.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66775.log.gz 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64480.log 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49759.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32529.log.gz 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64480.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64480.log.gz 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53493.log 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49759.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49759.log.gz 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53097.log 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53493.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53493.log.gz 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52267.log 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53097.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53097.log.gz 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60103.log 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52267.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52267.log.gz 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47070.log 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60103.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60103.log.gz 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51520.log 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47070.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47070.log.gz 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33332.log 2024-09-22T03:19:56.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58602.log 50.4% -- replaced with /var/log/ceph/ceph-client.admin.51520.log.gz 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33332.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33332.log.gz 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55741.log 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58602.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58602.log.gz 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57272.log 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55741.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.58246.log 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55741.log.gz 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57272.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57272.log.gz 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30171.log 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58246.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.58246.log.gz 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40452.log 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43824.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30171.log.gz 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40452.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40452.log.gz 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61710.log 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43824.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43824.log.gz 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36406.log 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42924.log 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61710.log.gz 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44632.log 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36406.log.gz 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42924.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42924.log.gz 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36595.log 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65724.log 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44632.log.gz 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36595.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36595.log.gz 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48558.log 2024-09-22T03:19:56.259 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.65724.log: /var/log/ceph/ceph-client.admin.41843.log 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.65724.log.gz 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48558.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48558.log.gz 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65909.log 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33472.log 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41843.log.gz 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34765.log 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65909.log.gz 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63723.log 48.0% -- replaced with /var/log/ceph/ceph-client.admin.33472.log.gz 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34765.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34765.log.gz 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59458.log 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63821.log 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63723.log.gz 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59458.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.59458.log.gz -5 2024-09-22T03:19:56.260 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42973.log 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48031.log 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63821.log.gz 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64227.log 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42973.log.gz 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44939.log 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48031.log.gz 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35839.log 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64227.log.gz 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44939.log: gzip -5 49.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44939.log.gz /var/log/ceph/ceph-client.admin.36833.log 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35839.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35839.log.gz 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.53851.log 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36833.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36833.log.gz 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66226.log 2024-09-22T03:19:56.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47288.log 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53851.log.gz 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47715.log 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66226.log.gz 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57352.log 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47288.log: /var/log/ceph/ceph-client.admin.47715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49361.log 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47288.log.gz 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47715.log.gz 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57352.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57352.log.gz 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55701.log 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49361.log.gz 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph.audit.log: -- /var/log/ceph/ceph-client.admin.52027.log 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55701.log: gzip 50.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.65910.log 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55701.log.gz 2024-09-22T03:19:56.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39841.log 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52027.log.gz 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43303.log 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65910.log: /var/log/ceph/ceph-client.admin.39841.log: gzip -5 --verbose 49.6% -- -- replaced with /var/log/ceph/ceph-client.admin.65910.log.gz /var/log/ceph/ceph-client.admin.55354.log 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39841.log.gz 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30079.log 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43303.log: /var/log/ceph/ceph-client.admin.55354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38782.log 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55354.log.gz 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43303.log.gz 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30079.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30079.log.gz 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46841.log 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46623.log 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38782.log.gz 2024-09-22T03:19:56.263 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41138.log 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46841.log.gz 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45547.log 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46623.log.gz 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50771.log 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41138.log.gz 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64709.log 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45547.log: /var/log/ceph/ceph-client.admin.50771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42230.log 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50771.log.gz 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45547.log.gz 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64709.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64709.log.gz 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42408.log 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42230.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42230.log.gz 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45587.log 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42408.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42408.log.gz 2024-09-22T03:19:56.264 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52443.log 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45587.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45587.log.gz 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58742.log 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52443.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52443.log.gz 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50533.log 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58742.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58742.log.gz 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.42835.log 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50533.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50533.log.gz 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51869.log 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42835.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42835.log.gz 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45756.log 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51869.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51869.log.gz 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44712.log 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45756.log: gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.40830.log 2024-09-22T03:19:56.265 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45756.log.gz 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36504.log 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44712.log.gz 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64758.log 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40830.log.gz 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64289.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36504.log.gz 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64758.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64758.log.gz 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60241.log 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64289.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64289.log.gz 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60668.log 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60241.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60241.log.gz 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.32111.log 2024-09-22T03:19:56.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60668.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60668.log.gz 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30121.log 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32111.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32111.log.gz 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34667.log 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53008.log 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30121.log.gz 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43581.log 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34667.log.gz 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53008.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53008.log.gz 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.51142.log 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43581.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43581.log.gz 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35234.log 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51142.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51142.log.gz 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48656.log 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35234.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35234.log.gz 2024-09-22T03:19:56.267 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.51191.log 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48656.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48656.log.gz 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39396.log 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51191.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51191.log.gz 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.38237.log 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39396.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59587.log 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39396.log.gz 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44346.log 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38237.log.gz 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53226.log 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59587.log.gz 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44346.log: gzip -5 --verbose -- 48.0% -- replaced with /var/log/ceph/ceph-client.admin.44346.log.gz 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.62667.log 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53226.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53226.log.gz 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29722.log 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62667.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62667.log.gz 2024-09-22T03:19:56.268 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.54249.log 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29722.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29722.log.gz 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45805.log 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51967.log 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54249.log.gz 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45805.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32976.log 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45805.log.gz 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41178.log 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51967.log.gz 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32976.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32976.log.gz 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.47330.log 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41178.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41178.log.gz 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62199.log 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47330.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47330.log.gz 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.40730.log 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62199.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62199.log.gz 2024-09-22T03:19:56.269 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32340.log 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58126.log 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40730.log.gz 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32340.log: gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.57579.log 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32340.log.gz 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62332.log 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58126.log.gz 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59051.log 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57579.log.gz 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49123.log 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62332.log.gz 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46392.log 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59051.log.gz 2024-09-22T03:19:56.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29947.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49123.log.gz 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46392.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46392.log.gz 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48160.log 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29947.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29947.log.gz 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64779.log 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53533.log 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48160.log.gz 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64779.log: gzip -5 --verbose -- 49.2% -- replaced with /var/log/ceph/ceph-client.admin.64779.log.gz 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.63254.log 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53533.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53533.log.gz 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36546.log 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65514.log 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63254.log.gz 2024-09-22T03:19:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36546.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36546.log.gz 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.51380.log 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65514.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65514.log.gz 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40641.log 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51380.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51380.log.gz 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45994.log 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40641.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40641.log.gz 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43924.log 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45994.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45994.log.gz 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47804.log 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43924.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43924.log.gz 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.60766.log 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47804.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47804.log.gz 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32480.log 2024-09-22T03:19:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60766.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60766.log.gz 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37356.log 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32480.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32480.log.gz 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59329.log 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37356.log: gzip 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37356.log.gz 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56248.log 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59329.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59329.log.gz 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38593.log 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56248.log: /var/log/ceph/ceph-client.admin.36913.log 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56248.log.gz 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38593.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38593.log.gz 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50631.log 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62627.log 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36913.log.gz 2024-09-22T03:19:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46221.log 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50631.log.gz 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40592.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62627.log.gz 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46221.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46221.log.gz 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59140.log 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.40592.log: -- /var/log/ceph/ceph-client.admin.43410.log 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40592.log.gz 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59140.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59140.log.gz 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31893.log 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43410.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43410.log.gz 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.61850.log 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31893.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31893.log.gz 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64267.log 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57659.log 2024-09-22T03:19:56.274 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61850.log.gz 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64267.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64267.log.gz 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.47755.log 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57659.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57659.log.gz 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67027.log 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66606.log 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47755.log.gz 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67027.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67027.log.gz 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.59091.log 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66606.log: 50.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64052.log 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66606.log.gz 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32298.log 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59091.log.gz 2024-09-22T03:19:56.275 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64052.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64052.log.gz 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31495.log 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32298.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32298.log.gz 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39209.log 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31495.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28705.log 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31495.log.gz 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34807.log 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39209.log.gz 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28705.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28705.log.gz 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.28847.log 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34807.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34807.log.gz 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43504.log 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28847.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28847.log.gz 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37489.log 2024-09-22T03:19:56.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.43504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35274.log 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35611.log 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37489.log.gz 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35274.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35274.log.gz 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29561.log 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64400.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35611.log.gz 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29561.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58166.log 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29561.log.gz 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53613.log 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64400.log.gz 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36057.log 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58166.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58166.log.gz 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44979.log 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53613.log: /var/log/ceph/ceph-client.admin.36057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30346.log 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr: 49.2% 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36057.log.gz 2024-09-22T03:19:56.277 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53613.log.gz 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44979.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44979.log.gz 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50166.log 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30346.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56059.log 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30346.log.gz 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35185.log 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50166.log.gz 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49172.log 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56059.log: /var/log/ceph/ceph-client.admin.35185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54856.log 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56059.log.gz 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35185.log.gz 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52561.log 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49172.log: /var/log/ceph/ceph-client.admin.54856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55523.log 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49172.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54856.log.gz 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.278 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52561.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52561.log.gz 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52353.log 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55523.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55523.log.gz 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30038.log 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52353.log: /var/log/ceph/ceph-client.admin.35632.log 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6%/var/log/ceph/ceph-client.admin.30038.log: -- replaced with /var/log/ceph/ceph-client.admin.52353.log.gz 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30038.log.gz 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33605.log 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43452.log 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35632.log: /var/log/ceph/ceph-client.admin.33605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51829.log 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33605.log.gz 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35632.log.gz 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43452.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43452.log.gz 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47986.log 2024-09-22T03:19:56.279 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51829.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.51829.log.gz 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56150.log 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47986.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47986.log.gz 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53711.log 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5/var/log/ceph/ceph-client.admin.56150.log: --verbose -- /var/log/ceph/ceph-client.admin.60857.log 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6%/var/log/ceph/ceph-client.admin.53711.log: -- replaced with /var/log/ceph/ceph-client.admin.56150.log.gz 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62374.log 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53711.log.gz 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5/var/log/ceph/ceph-client.admin.60857.log: --verbose -- /var/log/ceph/ceph-client.admin.50275.log 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60857.log.gz 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62374.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62374.log.gz 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50911.log 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50275.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50275.log.gz 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34856.log 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.50911.log: -- /var/log/ceph/ceph-client.admin.44751.log 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.50911.log.gz 2024-09-22T03:19:56.280 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34856.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34856.log.gz 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33647.log 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44751.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44751.log.gz 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53991.log 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33647.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33647.log.gz 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52176.log 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41347.log 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53991.log: /var/log/ceph/ceph-client.admin.52176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41625.log 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53991.log.gz 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52176.log.gz 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34947.log 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41347.log: /var/log/ceph/ceph-client.admin.41625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46534.log 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41625.log.gz 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41347.log.gz 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34947.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34947.log.gz 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48954.log 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46534.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46534.log.gz 2024-09-22T03:19:56.281 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65027.log 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48954.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48954.log.gz 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.30566.log 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65027.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65027.log.gz 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39716.log 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30566.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30566.log.gz 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.52699.log 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39716.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39716.log.gz 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57450.log 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53453.log 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52699.log: /var/log/ceph/ceph-client.admin.57450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41944.log 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57450.log.gz 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52699.log.gz 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53453.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53453.log.gz 2024-09-22T03:19:56.282 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44890.log 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41944.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41944.log.gz 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42270.log 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37538.log 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44890.log: /var/log/ceph/ceph-client.admin.42270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66480.log 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42270.log.gz 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44890.log.gz 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37538.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37538.log.gz 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54627.log 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66480.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39776.log 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66480.log.gz 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61383.log 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54627.log.gz 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61423.log 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39776.log: /var/log/ceph/ceph-client.admin.61383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr: 49.2% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61383.log.gz 2024-09-22T03:19:56.283 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39776.log.gz 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61423.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61423.log.gz 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66690.log 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45238.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30606.log 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66690.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66690.log.gz 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41040.log 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48507.log 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30606.log: 50.0%/var/log/ceph/ceph-client.admin.41040.log: -- replaced with /var/log/ceph/ceph-client.admin.30606.log.gz 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41040.log.gz 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66564.log 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.48507.log: -- /var/log/ceph/ceph-client.admin.60201.log 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.48507.log.gz 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66564.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64440.log 2024-09-22T03:19:56.284 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66564.log.gz 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66901.log 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60201.log.gz 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.64440.log: -- /var/log/ceph/ceph-client.admin.47190.log 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64440.log.gz 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66901.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66901.log.gz 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45710.log 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47190.log: gzip -5 50.0% --verbose -- /var/log/ceph/ceph-client.admin.53802.log 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47190.log.gz 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45710.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45710.log.gz 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.45197.log 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53802.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53802.log.gz 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37846.log 2024-09-22T03:19:56.285 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45197.log: /var/log/ceph/ceph-client.admin.39627.log 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45197.log.gz 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37846.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37846.log.gz 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57708.log 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.39627.log: -- /var/log/ceph/ceph-client.admin.30526.log 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39627.log.gz 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57708.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57708.log.gz 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58344.log 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32718.log 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30526.log: /var/log/ceph/ceph-client.admin.58344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43714.log 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30526.log.gz 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58344.log.gz 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48736.log 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32718.log: /var/log/ceph/ceph-client.admin.43714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32389.log 2024-09-22T03:19:56.286 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32718.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43714.log.gz 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48736.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48736.log.gz 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40770.log 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32389.log: gzip -5 --verbose 50.0% -- /var/log/ceph/ceph-client.admin.29200.log 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32389.log.gz 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40770.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40770.log.gz 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.51240.log 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29200.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29200.log.gz 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41705.log 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51240.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51240.log.gz 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28889.log 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41705.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41705.log.gz 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.66438.log 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28889.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28889.log.gz 2024-09-22T03:19:56.287 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44065.log 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.66438.log: -- /var/log/ceph/ceph-client.admin.45371.log 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66438.log.gz 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44065.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44065.log.gz 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49481.log 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55074.log 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45371.log: /var/log/ceph/ceph-client.admin.49481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61521.log 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% 47.6% -- replaced with /var/log/ceph/ceph-client.admin.45371.log.gz 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49481.log.gz 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43232.log 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55074.log.gz 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61521.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61521.log.gz 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53146.log 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43232.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43232.log.gz 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56339.log 2024-09-22T03:19:56.288 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53146.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53146.log.gz 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29818.log 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40949.log 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56339.log: /var/log/ceph/ceph-client.admin.29818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60717.log 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56339.log.gz 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29818.log.gz 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55443.log 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40949.log: /var/log/ceph/ceph-client.admin.60717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31215.log 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40949.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60717.log.gz 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55443.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55443.log.gz 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65472.log/var/log/ceph/ceph-client.admin.31215.log: 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31215.log.gz 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54487.log 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65472.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65472.log.gz 2024-09-22T03:19:56.289 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33234.log 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54487.log: 49.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35701.log 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54487.log.gz 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46663.log 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33234.log.gz 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47675.log 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35701.log: 49.2%/var/log/ceph/ceph-client.admin.46663.log: -- replaced with /var/log/ceph/ceph-client.admin.35701.log.gz 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46663.log.gz 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64094.log 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47675.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58791.log 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47675.log.gz 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64094.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64094.log.gz 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58833.log 2024-09-22T03:19:56.290 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29032.log 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58833.log: /var/log/ceph/ceph-client.admin.58791.log: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58833.log.gz 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58791.log.gz 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56522.log 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29032.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42875.log 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29032.log.gz 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr:gzip/var/log/ceph/ceph-client.admin.56522.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53048.log 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56522.log.gz 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50722.log 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42875.log: /var/log/ceph/ceph-client.admin.53048.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42875.log.gz 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53048.log.gz 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46303.log 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59716.log 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50722.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50722.log.gz 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46303.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46303.log.gz 2024-09-22T03:19:56.291 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38762.log 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45463.log 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59716.log: /var/log/ceph/ceph-client.admin.38762.log: 50.4% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59716.log.gz 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38762.log.gz 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34616.log 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46442.log 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45463.log.gz 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63212.log 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46442.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34616.log.gz 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46442.log.gz 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56786.log 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53573.log 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63212.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63212.log.gz 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56786.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56786.log.gz 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45505.log 2024-09-22T03:19:56.292 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36664.log 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45505.log: /var/log/ceph/ceph-client.admin.53573.log: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45505.log.gz 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53573.log.gz 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29720.log 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52403.log 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36664.log.gz 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44394.log 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52403.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29720.log.gz 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52403.log.gz 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62282.log 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46692.log 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44394.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44394.log.gz 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62282.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62282.log.gz 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39249.log 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49848.log 2024-09-22T03:19:56.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39249.log: /var/log/ceph/ceph-client.admin.46692.log: 49.6% 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46692.log.gz 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39249.log.gz 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48103.log 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48696.log 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49848.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49848.log.gz 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.48103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50673.log 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48696.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48696.log.gz 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54389.log 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50673.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50673.log.gz 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37888.log 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54389.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54389.log.gz 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37400.log 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37888.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37888.log.gz 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55563.log 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37400.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37400.log.gz 2024-09-22T03:19:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30486.log 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55563.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55563.log.gz 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54896.log 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30486.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30486.log.gz 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51789.log 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54896.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54896.log.gz 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40025.log 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51789.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51789.log.gz 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51400.log 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40025.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40025.log.gz 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65067.log 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51400.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51400.log.gz 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60410.log 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65067.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65067.log.gz 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41487.log 2024-09-22T03:19:56.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60410.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60410.log.gz 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41585.log 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41487.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41487.log.gz 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60023.log 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41585.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41585.log.gz 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45059.log 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60023.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60023.log.gz 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61563.log 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45059.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45059.log.gz 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67111.log 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61563.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61563.log.gz 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45099.log 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67111.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67111.log.gz 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35492.log 2024-09-22T03:19:56.296 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45099.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45099.log.gz 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59236.log 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35492.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35492.log.gz 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55919.log 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59236.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59236.log.gz 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37182.log 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55919.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55919.log.gz 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66078.log 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37182.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37182.log.gz 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57470.log 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66078.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66078.log.gz 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36784.log 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57470.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57470.log.gz 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59378.log 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36784.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36784.log.gz 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51569.log 2024-09-22T03:19:56.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59378.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59378.log.gz 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29030.log 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51569.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.51569.log.gz 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57401.log 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29030.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29030.log.gz 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55661.log 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57401.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57401.log.gz 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32807.log 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55661.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55661.log.gz 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51611.log 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32807.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32807.log.gz 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61752.log 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51611.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51611.log.gz 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58882.log 2024-09-22T03:19:56.298 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61752.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61752.log.gz 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44773.log 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58882.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58882.log.gz 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40145.log 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44773.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44773.log.gz 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50017.log 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40145.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40145.log.gz 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62456.log 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50017.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50017.log.gz 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33283.log 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62456.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62456.log.gz 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36315.log 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33283.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33283.log.gz 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42012.log 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36315.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36315.log.gz 2024-09-22T03:19:56.299 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66018.log 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42012.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42012.log.gz 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65156.log 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66018.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66018.log.gz 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56974.log 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65156.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65156.log.gz 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37291.log 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56974.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56974.log.gz 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62974.log 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37291.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37291.log.gz 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52312.log 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62974.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62974.log.gz 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37968.log 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52312.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52312.log.gz 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58295.log 2024-09-22T03:19:56.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37968.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37968.log.gz 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48249.log 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58295.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58295.log.gz 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33374.log 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48249.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48249.log.gz 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54718.log 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33374.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33374.log.gz 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50453.log 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54718.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54718.log.gz 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55305.log 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50453.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50453.log.gz 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61930.log 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55305.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55305.log.gz 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38008.log 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61930.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61930.log.gz 2024-09-22T03:19:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49619.log 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38008.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38008.log.gz 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43974.log 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49619.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49619.log.gz 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48072.log 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43974.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43974.log.gz 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56473.log 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48072.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48072.log.gz 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62547.log 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56473.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56473.log.gz 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39934.log 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62547.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62547.log.gz 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67151.log 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39934.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39934.log.gz 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35750.log 2024-09-22T03:19:56.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67151.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67151.log.gz 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56566.log 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35750.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35750.log.gz 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55165.log 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56566.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56566.log.gz 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53900.log 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55165.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55165.log.gz 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54080.log 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53900.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53900.log.gz 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42575.log 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54080.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54080.log.gz 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36647.log 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42575.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42575.log.gz 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44492.log 2024-09-22T03:19:56.303 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36647.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36647.log.gz 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35394.log 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44492.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44492.log.gz 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64114.log 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35394.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35394.log.gz 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63303.log 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64114.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64114.log.gz 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32131.log 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63303.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63303.log.gz 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46932.log 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32131.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32131.log.gz 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64360.log 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46932.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46932.log.gz 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42755.log 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64360.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64360.log.gz 2024-09-22T03:19:56.304 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63163.log 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42755.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42755.log.gz 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31404.log 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63163.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63163.log.gz 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48369.log 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31404.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31404.log.gz 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61084.log 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48369.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48369.log.gz 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60341.log 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61084.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61084.log.gz 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46792.log 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60341.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60341.log.gz 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63394.log 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46792.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46792.log.gz 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55803.log 2024-09-22T03:19:56.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63394.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63394.log.gz 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49263.log 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55803.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55803.log.gz 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62587.log 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49263.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49263.log.gz 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59636.log 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62587.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62587.log.gz 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50811.log 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59636.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59636.log.gz 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62010.log 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50811.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50811.log.gz 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39347.log 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62010.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62010.log.gz 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49441.log 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39347.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39347.log.gz 2024-09-22T03:19:56.306 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50146.log 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49441.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49441.log.gz 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51749.log 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50146.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.50146.log.gz 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54767.log 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51749.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.51749.log.gz 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64008.log 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54767.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54767.log.gz 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63961.log 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64008.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64008.log.gz 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61343.log 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63961.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63961.log.gz 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42488.log 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61343.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61343.log.gz 2024-09-22T03:19:56.307 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43063.log 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42488.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42488.log.gz 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28477.log 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43063.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43063.log.gz 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55483.log 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28477.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28477.log.gz 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62059.log 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55483.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55483.log.gz 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33780.log 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62059.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62059.log.gz 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33780.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33780.log.gz 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54578.log 2024-09-22T03:19:56.308 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.log: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T03:19:56.321 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59011.log 2024-09-22T03:19:56.321 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54578.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54578.log.gz 2024-09-22T03:19:56.321 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31165.log 2024-09-22T03:19:56.321 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59011.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59011.log.gz 2024-09-22T03:19:56.321 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57232.log 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31165.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31165.log.gz 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29161.log 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57232.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57232.log.gz 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54976.log 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29161.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29161.log.gz 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33065.log 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54976.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54976.log.gz 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61472.log 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33065.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33065.log.gz 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28788.log 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61472.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61472.log.gz 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50862.log 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28788.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.28788.log.gz 2024-09-22T03:19:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35572.log 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50862.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50862.log.gz 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33423.log 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35572.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35572.log.gz 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49888.log 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33423.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33423.log.gz 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29890.log 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49888.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49888.log.gz 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41794.log 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.29890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51282.log 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41794.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41794.log.gz 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33942.log 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51282.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51282.log.gz 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36993.log 2024-09-22T03:19:56.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33942.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33942.log.gz 2024-09-22T03:19:56.324 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61125.log 2024-09-22T03:19:56.324 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36993.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36993.log.gz 2024-09-22T03:19:56.324 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57312.log 2024-09-22T03:19:56.324 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61125.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61125.log.gz 2024-09-22T03:19:56.325 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35959.log 2024-09-22T03:19:56.326 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57312.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57312.log.gz 2024-09-22T03:19:56.343 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38484.log 2024-09-22T03:19:56.344 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35959.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35959.log.gz 2024-09-22T03:19:56.352 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40410.log 2024-09-22T03:19:56.353 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38484.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38484.log.gz 2024-09-22T03:19:56.369 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-09-22T03:19:56.369 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40410.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40410.log.gz 2024-09-22T03:19:56.378 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62241.log 2024-09-22T03:19:56.378 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41089.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-09-22T03:19:56.391 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63492.log 2024-09-22T03:19:56.392 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62241.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62241.log.gz 2024-09-22T03:19:56.401 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52650.log 2024-09-22T03:19:56.401 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63492.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63492.log.gz 2024-09-22T03:19:56.409 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47150.log 2024-09-22T03:19:56.423 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52650.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52650.log.gz 2024-09-22T03:19:56.428 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63912.log 2024-09-22T03:19:56.429 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47150.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47150.log.gz 2024-09-22T03:19:56.448 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29477.log 2024-09-22T03:19:56.449 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63912.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.63912.log.gz 2024-09-22T03:19:56.457 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54160.log 2024-09-22T03:19:56.467 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45945.log 2024-09-22T03:19:56.470 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54160.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29477.log.gz 2024-09-22T03:19:56.479 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54160.log.gz 2024-09-22T03:19:56.483 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51002.log 2024-09-22T03:19:56.483 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45945.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45945.log.gz 2024-09-22T03:19:56.491 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33902.log 2024-09-22T03:19:56.502 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59797.log 2024-09-22T03:19:56.502 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33902.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33902.log.gz 2024-09-22T03:19:56.504 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51002.log.gz 2024-09-22T03:19:56.512 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31025.log 2024-09-22T03:19:56.513 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59797.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59797.log.gz 2024-09-22T03:19:56.521 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55025.log 2024-09-22T03:19:56.531 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55254.log 2024-09-22T03:19:56.531 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55025.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55025.log.gz 2024-09-22T03:19:56.535 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31025.log.gz 2024-09-22T03:19:56.539 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63863.log 2024-09-22T03:19:56.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55254.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55254.log.gz 2024-09-22T03:19:56.553 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31074.log 2024-09-22T03:19:56.554 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63863.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63863.log.gz 2024-09-22T03:19:56.562 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53355.log 2024-09-22T03:19:56.566 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31074.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31074.log.gz 2024-09-22T03:19:56.577 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43167.log 2024-09-22T03:19:56.578 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53355.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53355.log.gz 2024-09-22T03:19:56.587 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64520.log 2024-09-22T03:19:56.596 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37804.log 2024-09-22T03:19:56.596 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64520.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.64520.log.gz 2024-09-22T03:19:56.599 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43167.log.gz 2024-09-22T03:19:56.605 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41218.log 2024-09-22T03:19:56.618 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37804.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37804.log.gz 2024-09-22T03:19:56.618 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32071.log 2024-09-22T03:19:56.619 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41218.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41218.log.gz 2024-09-22T03:19:56.627 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39438.log 2024-09-22T03:19:56.637 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32767.log 2024-09-22T03:19:56.637 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39438.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39438.log.gz 2024-09-22T03:19:56.640 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32071.log.gz 2024-09-22T03:19:56.645 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66077.log 2024-09-22T03:19:56.656 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53186.log 2024-09-22T03:19:56.656 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66077.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66077.log.gz 2024-09-22T03:19:56.659 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32767.log.gz 2024-09-22T03:19:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39676.log 2024-09-22T03:19:56.668 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53186.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53186.log.gz 2024-09-22T03:19:56.680 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29393.log 2024-09-22T03:19:56.680 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39676.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.39676.log.gz 2024-09-22T03:19:56.688 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43492.log 2024-09-22T03:19:56.698 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57094.log 2024-09-22T03:19:56.698 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43492.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43492.log.gz 2024-09-22T03:19:56.701 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29393.log.gz 2024-09-22T03:19:56.706 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30695.log 2024-09-22T03:19:56.719 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57094.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.57094.log.gz 2024-09-22T03:19:56.720 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48994.log 2024-09-22T03:19:56.721 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30695.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30695.log.gz 2024-09-22T03:19:56.739 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38642.log 2024-09-22T03:19:56.739 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48994.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48994.log.gz 2024-09-22T03:19:56.747 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42052.log 2024-09-22T03:19:56.756 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37091.log 2024-09-22T03:19:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45019.log 2024-09-22T03:19:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37091.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38642.log.gz 2024-09-22T03:19:56.769 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42052.log.gz 2024-09-22T03:19:56.775 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37671.log 2024-09-22T03:19:56.778 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45019.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.37091.log.gz 2024-09-22T03:19:56.785 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37713.log 2024-09-22T03:19:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37671.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45019.log.gz 2024-09-22T03:19:56.797 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37671.log.gz 2024-09-22T03:19:56.797 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28449.log 2024-09-22T03:19:56.797 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37713.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37713.log.gz 2024-09-22T03:19:56.806 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40305.log 2024-09-22T03:19:56.815 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57897.log 2024-09-22T03:19:56.815 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40305.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40305.log.gz 2024-09-22T03:19:56.818 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28449.log.gz 2024-09-22T03:19:56.824 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52007.log 2024-09-22T03:19:56.831 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57897.log: 89.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-22T03:19:56.832 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57897.log.gz 2024-09-22T03:19:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60628.log 2024-09-22T03:19:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52007.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52007.log.gz 2024-09-22T03:19:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63443.log 2024-09-22T03:19:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60628.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60628.log.gz 2024-09-22T03:19:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39169.log 2024-09-22T03:19:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63443.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63443.log.gz 2024-09-22T03:19:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45392.log 2024-09-22T03:19:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39169.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39169.log.gz 2024-09-22T03:19:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43014.log 2024-09-22T03:19:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45392.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45392.log.gz 2024-09-22T03:19:56.837 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35799.log 2024-09-22T03:19:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43014.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43014.log.gz 2024-09-22T03:19:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65430.log 2024-09-22T03:19:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35799.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35799.log.gz 2024-09-22T03:19:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32438.log 2024-09-22T03:19:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65430.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65430.log.gz 2024-09-22T03:19:56.842 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40194.log 2024-09-22T03:19:56.842 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32438.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32438.log.gz 2024-09-22T03:19:56.842 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44443.log 2024-09-22T03:19:56.842 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40194.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40194.log.gz 2024-09-22T03:19:56.842 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59498.log 2024-09-22T03:19:56.843 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44443.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44443.log.gz 2024-09-22T03:19:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28214.log 2024-09-22T03:19:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59498.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59498.log.gz 2024-09-22T03:19:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45647.log 2024-09-22T03:19:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28214.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28214.log.gz 2024-09-22T03:19:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32927.log 2024-09-22T03:19:56.848 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45647.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45647.log.gz 2024-09-22T03:19:56.848 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39985.log 2024-09-22T03:19:56.848 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32927.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32927.log.gz 2024-09-22T03:19:56.848 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37042.log 2024-09-22T03:19:56.848 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39985.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.39985.log.gz 2024-09-22T03:19:56.851 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58424.log 2024-09-22T03:19:56.851 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37042.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37042.log.gz 2024-09-22T03:19:56.851 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42359.log 2024-09-22T03:19:56.851 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58424.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58424.log.gz 2024-09-22T03:19:56.851 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35879.log 2024-09-22T03:19:56.853 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42359.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42359.log.gz 2024-09-22T03:19:56.853 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44534.log 2024-09-22T03:19:56.853 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35879.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35879.log.gz 2024-09-22T03:19:56.853 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65345.log 2024-09-22T03:19:56.853 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44534.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44534.log.gz 2024-09-22T03:19:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52136.log 2024-09-22T03:19:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65345.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65345.log.gz 2024-09-22T03:19:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29721.log 2024-09-22T03:19:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52136.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52136.log.gz 2024-09-22T03:19:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56638.log 2024-09-22T03:19:56.857 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29721.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29721.log.gz 2024-09-22T03:19:56.857 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51471.log 2024-09-22T03:19:56.871 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.56638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38682.log 2024-09-22T03:19:56.871 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51471.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.51471.log.gz 2024-09-22T03:19:56.885 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48776.log 2024-09-22T03:19:56.885 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38682.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38682.log.gz 2024-09-22T03:19:56.900 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41883.log 2024-09-22T03:19:56.900 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48776.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48776.log.gz 2024-09-22T03:19:56.909 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36455.log 2024-09-22T03:19:56.909 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41883.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41883.log.gz 2024-09-22T03:19:56.918 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57054.log 2024-09-22T03:19:56.918 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36455.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36455.log.gz 2024-09-22T03:19:56.927 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35919.log 2024-09-22T03:19:56.927 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57054.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57054.log.gz 2024-09-22T03:19:56.941 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50106.log 2024-09-22T03:19:56.941 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35919.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35919.log.gz 2024-09-22T03:19:56.955 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52968.log 2024-09-22T03:19:56.955 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50106.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50106.log.gz 2024-09-22T03:19:56.965 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35354.log 2024-09-22T03:19:56.965 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52968.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52968.log.gz 2024-09-22T03:19:56.979 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56836.log 2024-09-22T03:19:56.979 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35354.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35354.log.gz 2024-09-22T03:19:56.991 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44023.log 2024-09-22T03:19:56.992 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56836.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56836.log.gz 2024-09-22T03:19:57.000 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60548.log 2024-09-22T03:19:57.000 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44023.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44023.log.gz 2024-09-22T03:19:57.010 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44205.log 2024-09-22T03:19:57.010 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60548.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60548.log.gz 2024-09-22T03:19:57.024 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45330.log 2024-09-22T03:19:57.024 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44205.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44205.log.gz 2024-09-22T03:19:57.039 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30793.log 2024-09-22T03:19:57.039 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45330.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45330.log.gz 2024-09-22T03:19:57.054 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61156.log 2024-09-22T03:19:57.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30793.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30793.log.gz 2024-09-22T03:19:57.069 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36873.log 2024-09-22T03:19:57.079 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.61156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31942.log 2024-09-22T03:19:57.079 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36873.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36873.log.gz 2024-09-22T03:19:57.088 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40501.log 2024-09-22T03:19:57.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31942.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31942.log.gz 2024-09-22T03:19:57.094 INFO:teuthology.orchestra.run.smithi134.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.34281.log.gz 2024-09-22T03:19:57.095 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56429.log 2024-09-22T03:19:57.095 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40501.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.40501.log.gz 2024-09-22T03:19:57.097 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54529.log 2024-09-22T03:19:57.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56429.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56429.log.gz 2024-09-22T03:19:57.097 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38028.log 2024-09-22T03:19:57.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54529.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54529.log.gz 2024-09-22T03:19:57.099 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62925.log 2024-09-22T03:19:57.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38028.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38028.log.gz 2024-09-22T03:19:57.101 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31264.log 2024-09-22T03:19:57.101 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62925.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62925.log.gz 2024-09-22T03:19:57.102 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30388.log 2024-09-22T03:19:57.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31264.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31264.log.gz 2024-09-22T03:19:57.102 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59943.log 2024-09-22T03:19:57.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30388.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30388.log.gz 2024-09-22T03:19:57.104 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56608.log 2024-09-22T03:19:57.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59943.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59943.log.gz 2024-09-22T03:19:57.104 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47595.log 2024-09-22T03:19:57.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56608.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56608.log.gz 2024-09-22T03:19:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36137.log 2024-09-22T03:19:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47595.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47595.log.gz 2024-09-22T03:19:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34167.log 2024-09-22T03:19:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36137.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36137.log.gz 2024-09-22T03:19:57.108 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58464.log 2024-09-22T03:19:57.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34167.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34167.log.gz 2024-09-22T03:19:57.109 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58693.log 2024-09-22T03:19:57.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58464.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58464.log.gz 2024-09-22T03:19:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49808.log 2024-09-22T03:19:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58693.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58693.log.gz 2024-09-22T03:19:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40900.log 2024-09-22T03:19:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49808.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49808.log.gz 2024-09-22T03:19:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51709.log 2024-09-22T03:19:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40900.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40900.log.gz 2024-09-22T03:19:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43876.log 2024-09-22T03:19:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51709.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51709.log.gz 2024-09-22T03:19:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39578.log 2024-09-22T03:19:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43876.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43876.log.gz 2024-09-22T03:19:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61801.log 2024-09-22T03:19:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39578.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39578.log.gz 2024-09-22T03:19:57.117 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60987.log 2024-09-22T03:19:57.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61801.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61801.log.gz 2024-09-22T03:19:57.117 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61302.log 2024-09-22T03:19:57.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60987.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60987.log.gz 2024-09-22T03:19:57.120 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52601.log 2024-09-22T03:19:57.120 INFO:teuthology.orchestra.run.smithi134.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.38536.log.gz 2024-09-22T03:19:57.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2024-09-22T03:19:57.120 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61302.log.gz 2024-09-22T03:19:57.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52601.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52601.log.gz 2024-09-22T03:19:57.120 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49054.log 2024-09-22T03:19:57.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46154.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2024-09-22T03:19:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35314.log 2024-09-22T03:19:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49054.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49054.log.gz 2024-09-22T03:19:57.124 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52078.log 2024-09-22T03:19:57.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35314.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35314.log.gz 2024-09-22T03:19:57.124 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45854.log 2024-09-22T03:19:57.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52078.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52078.log.gz 2024-09-22T03:19:57.126 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53662.log 2024-09-22T03:19:57.126 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45854.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45854.log.gz 2024-09-22T03:19:57.126 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57538.log 2024-09-22T03:19:57.126 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53662.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53662.log.gz 2024-09-22T03:19:57.127 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49710.log 2024-09-22T03:19:57.127 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57538.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57538.log.gz 2024-09-22T03:19:57.128 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34716.log 2024-09-22T03:19:57.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49710.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49710.log.gz 2024-09-22T03:19:57.129 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49034.log 2024-09-22T03:19:57.130 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34716.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34716.log.gz 2024-09-22T03:19:57.130 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47546.log 2024-09-22T03:19:57.130 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49034.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49034.log.gz 2024-09-22T03:19:57.132 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47457.log 2024-09-22T03:19:57.132 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47546.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47546.log.gz 2024-09-22T03:19:57.132 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58086.log 2024-09-22T03:19:57.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47457.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47457.log.gz 2024-09-22T03:19:57.134 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66648.log 2024-09-22T03:19:57.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58086.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.58086.log.gz 2024-09-22T03:19:57.135 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45288.log 2024-09-22T03:19:57.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66648.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66648.log.gz 2024-09-22T03:19:57.136 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52928.log 2024-09-22T03:19:57.137 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45288.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45288.log.gz 2024-09-22T03:19:57.137 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38722.log 2024-09-22T03:19:57.137 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52928.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52928.log.gz 2024-09-22T03:19:57.139 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32669.log 2024-09-22T03:19:57.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38722.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38722.log.gz 2024-09-22T03:19:57.139 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64898.log 2024-09-22T03:19:57.140 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32669.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.32669.log.gz 2024-09-22T03:19:57.141 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47894.log 2024-09-22T03:19:57.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64898.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64898.log.gz 2024-09-22T03:19:57.143 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39040.log 2024-09-22T03:19:57.143 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47894.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47894.log.gz 2024-09-22T03:19:57.143 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34122.log 2024-09-22T03:19:57.143 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39040.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39040.log.gz 2024-09-22T03:19:57.145 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43168.log 2024-09-22T03:19:57.145 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34122.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34122.log.gz 2024-09-22T03:19:57.145 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37580.log 2024-09-22T03:19:57.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43168.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43168.log.gz 2024-09-22T03:19:57.146 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34338.log 2024-09-22T03:19:57.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37580.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37580.log.gz 2024-09-22T03:19:57.147 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64849.log 2024-09-22T03:19:57.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34338.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34338.log.gz 2024-09-22T03:19:57.149 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48209.log 2024-09-22T03:19:57.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64849.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64849.log.gz 2024-09-22T03:19:57.149 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41298.log 2024-09-22T03:19:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48209.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48209.log.gz 2024-09-22T03:19:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36008.log 2024-09-22T03:19:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41298.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41298.log.gz 2024-09-22T03:19:57.153 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28931.log 2024-09-22T03:19:57.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36008.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36008.log.gz 2024-09-22T03:19:57.153 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57014.log 2024-09-22T03:19:57.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28931.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28931.log.gz 2024-09-22T03:19:57.154 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52483.log 2024-09-22T03:19:57.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57014.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57014.log.gz 2024-09-22T03:19:57.155 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59894.log 2024-09-22T03:19:57.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52483.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.52483.log.gz 2024-09-22T03:19:57.157 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31991.log 2024-09-22T03:19:57.157 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59894.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59894.log.gz 2024-09-22T03:19:57.157 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62108.log 2024-09-22T03:19:57.159 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31991.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31991.log.gz 2024-09-22T03:19:57.159 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47635.log 2024-09-22T03:19:57.159 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62108.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62108.log.gz 2024-09-22T03:19:57.160 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31114.log 2024-09-22T03:19:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47635.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47635.log.gz 2024-09-22T03:19:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54298.log 2024-09-22T03:19:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31114.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31114.log.gz 2024-09-22T03:19:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44254.log 2024-09-22T03:19:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54298.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54298.log.gz 2024-09-22T03:19:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30835.log 2024-09-22T03:19:57.164 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44254.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44254.log.gz 2024-09-22T03:19:57.165 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56885.log 2024-09-22T03:19:57.165 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30835.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30835.log.gz 2024-09-22T03:19:57.166 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48418.log 2024-09-22T03:19:57.166 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56885.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56885.log.gz 2024-09-22T03:19:57.166 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33165.log 2024-09-22T03:19:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48418.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48418.log.gz 2024-09-22T03:19:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53753.log 2024-09-22T03:19:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33165.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33165.log.gz 2024-09-22T03:19:57.170 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29201.log 2024-09-22T03:19:57.170 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53753.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53753.log.gz 2024-09-22T03:19:57.170 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42666.log 2024-09-22T03:19:57.171 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29201.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29201.log.gz 2024-09-22T03:19:57.171 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65107.log 2024-09-22T03:19:57.171 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42666.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42666.log.gz 2024-09-22T03:19:57.173 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55214.log 2024-09-22T03:19:57.173 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65107.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65107.log.gz 2024-09-22T03:19:57.173 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34387.log 2024-09-22T03:19:57.175 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55214.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55214.log.gz 2024-09-22T03:19:57.175 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63043.log 2024-09-22T03:19:57.175 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34387.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34387.log.gz 2024-09-22T03:19:57.176 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50493.log 2024-09-22T03:19:57.176 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63043.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.63043.log.gz 2024-09-22T03:19:57.178 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30934.log 2024-09-22T03:19:57.178 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50493.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50493.log.gz 2024-09-22T03:19:57.178 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65640.log 2024-09-22T03:19:57.179 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30934.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30934.log.gz 2024-09-22T03:19:57.180 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56108.log 2024-09-22T03:19:57.180 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65640.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65640.log.gz 2024-09-22T03:19:57.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63583.log 2024-09-22T03:19:57.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56108.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56108.log.gz 2024-09-22T03:19:57.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41258.log 2024-09-22T03:19:57.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63583.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63583.log.gz 2024-09-22T03:19:57.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42715.log 2024-09-22T03:19:57.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41258.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41258.log.gz 2024-09-22T03:19:57.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66186.log 2024-09-22T03:19:57.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42715.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42715.log.gz 2024-09-22T03:19:57.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55870.log 2024-09-22T03:19:57.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66186.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66186.log.gz 2024-09-22T03:19:57.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31851.log 2024-09-22T03:19:57.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55870.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55870.log.gz 2024-09-22T03:19:57.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66733.log 2024-09-22T03:19:57.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31851.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31851.log.gz 2024-09-22T03:19:57.189 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59736.log 2024-09-22T03:19:57.189 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66733.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66733.log.gz 2024-09-22T03:19:57.189 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54345.log 2024-09-22T03:19:57.191 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59736.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59736.log.gz 2024-09-22T03:19:57.191 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52739.log 2024-09-22T03:19:57.191 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54345.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54345.log.gz 2024-09-22T03:19:57.193 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59845.log 2024-09-22T03:19:57.193 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52739.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52739.log.gz 2024-09-22T03:19:57.193 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57799.log 2024-09-22T03:19:57.193 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59845.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59845.log.gz 2024-09-22T03:19:57.194 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38286.log 2024-09-22T03:19:57.194 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57799.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57799.log.gz 2024-09-22T03:19:57.196 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62765.log 2024-09-22T03:19:57.196 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38286.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38286.log.gz 2024-09-22T03:19:57.196 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51100.log 2024-09-22T03:19:57.198 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62765.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62765.log.gz 2024-09-22T03:19:57.198 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34996.log 2024-09-22T03:19:57.198 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51100.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51100.log.gz 2024-09-22T03:19:57.200 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49639.log 2024-09-22T03:19:57.200 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34996.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34996.log.gz 2024-09-22T03:19:57.200 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54669.log 2024-09-22T03:19:57.201 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49639.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49639.log.gz 2024-09-22T03:19:57.201 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53404.log 2024-09-22T03:19:57.201 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54669.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54669.log.gz 2024-09-22T03:19:57.203 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56744.log 2024-09-22T03:19:57.203 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53404.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53404.log.gz 2024-09-22T03:19:57.203 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31602.log 2024-09-22T03:19:57.203 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56744.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56744.log.gz 2024-09-22T03:19:57.205 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54120.log 2024-09-22T03:19:57.205 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31602.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31602.log.gz 2024-09-22T03:19:57.205 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52486.log 2024-09-22T03:19:57.207 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54120.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54120.log.gz 2024-09-22T03:19:57.207 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47030.log 2024-09-22T03:19:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.52486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41903.log 2024-09-22T03:19:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47030.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47030.log.gz 2024-09-22T03:19:57.230 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65387.log 2024-09-22T03:19:57.230 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41903.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41903.log.gz 2024-09-22T03:19:57.236 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56926.log 2024-09-22T03:19:57.237 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65387.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65387.log.gz 2024-09-22T03:19:57.245 INFO:teuthology.orchestra.run.smithi134.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.43504.log.gz 2024-09-22T03:19:57.245 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65682.log 2024-09-22T03:19:57.246 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56926.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56926.log.gz 2024-09-22T03:19:57.246 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46085.log 2024-09-22T03:19:57.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65682.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65682.log.gz 2024-09-22T03:19:57.247 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29519.log 2024-09-22T03:19:57.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46085.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.46085.log.gz 2024-09-22T03:19:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60321.log 2024-09-22T03:19:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29519.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29519.log.gz 2024-09-22T03:19:57.251 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66859.log 2024-09-22T03:19:57.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60321.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60321.log.gz 2024-09-22T03:19:57.251 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47417.log 2024-09-22T03:19:57.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66859.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66859.log.gz 2024-09-22T03:19:57.252 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29160.log 2024-09-22T03:19:57.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47417.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47417.log.gz 2024-09-22T03:19:57.252 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40243.log 2024-09-22T03:19:57.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29160.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29160.log.gz 2024-09-22T03:19:57.253 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56199.log 2024-09-22T03:19:57.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40243.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.40243.log.gz 2024-09-22T03:19:57.253 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30976.log 2024-09-22T03:19:57.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56199.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.56199.log.gz 2024-09-22T03:19:57.254 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49312.log 2024-09-22T03:19:57.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30976.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30976.log.gz 2024-09-22T03:19:57.255 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46890.log 2024-09-22T03:19:57.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49312.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49312.log.gz 2024-09-22T03:19:57.255 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31670.log 2024-09-22T03:19:57.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46890.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46890.log.gz 2024-09-22T03:19:57.257 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31306.log 2024-09-22T03:19:57.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31670.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31670.log.gz 2024-09-22T03:19:57.257 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62845.log 2024-09-22T03:19:57.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.31306.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31306.log.gz 2024-09-22T03:19:57.258 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66351.log 2024-09-22T03:19:57.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62845.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62845.log.gz 2024-09-22T03:19:57.259 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35065.log 2024-09-22T03:19:57.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66351.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66351.log.gz 2024-09-22T03:19:57.260 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45896.log 2024-09-22T03:19:57.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.35065.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35065.log.gz 2024-09-22T03:19:57.261 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44303.log 2024-09-22T03:19:57.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45896.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45896.log.gz 2024-09-22T03:19:57.262 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37600.log 2024-09-22T03:19:57.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44303.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44303.log.gz 2024-09-22T03:19:57.263 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63681.log 2024-09-22T03:19:57.263 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37600.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37600.log.gz 2024-09-22T03:19:57.263 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52217.log 2024-09-22T03:19:57.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63681.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63681.log.gz 2024-09-22T03:19:57.264 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29309.log 2024-09-22T03:19:57.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52217.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.52217.log.gz 2024-09-22T03:19:57.265 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34478.log 2024-09-22T03:19:57.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29309.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29309.log.gz 2024-09-22T03:19:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28293.log 2024-09-22T03:19:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34478.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34478.log.gz 2024-09-22T03:19:57.267 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30646.log 2024-09-22T03:19:57.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28293.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28293.log.gz 2024-09-22T03:19:57.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30646.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30646.log.gz 2024-09-22T03:19:57.282 INFO:teuthology.orchestra.run.smithi134.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.48103.log.gz 2024-09-22T03:19:57.393 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-22T03:19:57.523 INFO:teuthology.orchestra.run.smithi134.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.29890.log.gz 2024-09-22T03:19:57.887 INFO:teuthology.orchestra.run.smithi134.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.61156.log.gz 2024-09-22T03:19:57.940 INFO:teuthology.orchestra.run.smithi134.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.52486.log.gz 2024-09-22T03:19:57.974 INFO:teuthology.orchestra.run.smithi134.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.56638.log.gz 2024-09-22T03:20:35.529 INFO:teuthology.orchestra.run.smithi139.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-22T03:20:37.411 INFO:teuthology.orchestra.run.smithi139.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-22T03:20:37.413 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-09-22T03:20:37.413 INFO:teuthology.orchestra.run.smithi139.stderr:real 0m41.437s 2024-09-22T03:20:37.413 INFO:teuthology.orchestra.run.smithi139.stderr:user 1m18.218s 2024-09-22T03:20:37.413 INFO:teuthology.orchestra.run.smithi139.stderr:sys 0m2.714s 2024-09-22T03:20:41.489 INFO:teuthology.orchestra.run.smithi134.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-22T03:20:44.392 INFO:teuthology.orchestra.run.smithi134.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-22T03:20:44.394 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-22T03:20:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m48.464s 2024-09-22T03:20:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:user 1m39.550s 2024-09-22T03:20:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m3.965s 2024-09-22T03:20:44.395 INFO:tasks.ceph:Archiving logs... 2024-09-22T03:20:44.395 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914719/remote/smithi134/log 2024-09-22T03:20:44.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T03:20:59.769 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914719/remote/smithi139/log 2024-09-22T03:20:59.769 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T03:21:12.091 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-22T03:21:12.106 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-22T03:21:12.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T03:21:12.108 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T03:21:12.194 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-22T03:21:12.204 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-22T03:21:12.204 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T03:21:12.207 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T03:21:12.221 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-22T03:21:12.223 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-09-22T03:21:12.226 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T03:21:12.226 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-22T03:21:12.227 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 -104us[ -96us] +/- 41ms 2024-09-22T03:21:12.227 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 +421us[ +421us] +/- 65ms 2024-09-22T03:21:12.227 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 -238us[ -238us] +/- 65ms 2024-09-22T03:21:12.227 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:21:12.228 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T03:21:12.228 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-09-22T03:21:12.228 INFO:teuthology.orchestra.run.smithi139.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 -105us[ -89us] +/- 41ms 2024-09-22T03:21:12.228 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 +420us[ +420us] +/- 65ms 2024-09-22T03:21:12.229 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -257us[ -241us] +/- 65ms 2024-09-22T03:21:12.229 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:21:12.229 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-22T03:21:12.270 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-22T03:21:12.271 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-22T03:21:12.325 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T03:21:12.411 DEBUG:teuthology.orchestra.run.smithi139:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T03:21:12.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-22T03:21:12.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:21:12.510 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-22T03:21:12.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:21:12.540 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-22T03:21:12.594 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-22T03:21:12.711 INFO:teuthology.task.internal:Duration was 1464.873279 seconds 2024-09-22T03:21:12.711 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-22T03:21:12.796 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-22T03:21:12.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T03:21:12.804 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T03:21:12.843 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T03:21:12.848 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T03:21:13.330 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-22T03:21:13.330 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-22T03:21:13.330 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T03:21:13.395 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-09-22T03:21:13.395 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T03:21:13.427 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-22T03:21:13.427 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T03:21:13.439 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T03:21:13.500 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-22T03:21:13.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T03:21:13.513 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T03:21:13.646 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-22T03:21:13.656 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-22T03:21:13.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T03:21:13.681 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T03:21:13.708 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-22T03:21:13.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T03:21:13.771 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T03:21:13.791 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-22T03:21:13.795 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-09-22T03:21:13.826 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T03:21:13.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:21:13.881 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T03:21:13.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:21:13.897 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-22T03:21:13.908 INFO:teuthology.task.internal:Transferring archived files... 2024-09-22T03:21:13.909 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914719/remote/smithi134 2024-09-22T03:21:13.909 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T03:21:13.955 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914719/remote/smithi139 2024-09-22T03:21:13.955 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T03:21:13.988 INFO:teuthology.task.internal:Removing archive directory... 2024-09-22T03:21:13.988 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T03:21:13.993 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T03:21:14.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-22T03:21:14.050 INFO:teuthology.task.internal:Not uploading archives. 2024-09-22T03:21:14.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-22T03:21:14.101 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-22T03:21:14.101 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T03:21:14.104 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T03:21:14.117 INFO:teuthology.orchestra.run.smithi134.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 03:21 /home/ubuntu/cephtest 2024-09-22T03:21:14.120 INFO:teuthology.orchestra.run.smithi139.stdout: 265733 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 03:21 /home/ubuntu/cephtest 2024-09-22T03:21:14.121 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-22T03:21:14.176 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-22T03:21:14.311 INFO:teuthology.run:Summary data: description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency} duration: 1464.8732788562775 flavor: crimson owner: scheduled_teuthology@teuthology success: true 2024-09-22T03:21:14.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T03:21:14.387 INFO:teuthology.run:pass